00000001:02000400:2.0F:1788836258.343326:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788836267.317796:0:3491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788836269.520788:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 392 MB/s 00000001:01000000:0.0F:1788836269.770124:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 491 MB/s 00000001:01000000:0.0:1788836270.020878:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5203 MB/s 00000020:02000000:1.0:1788836271.067289:0:3582:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_113_gf5ca795 00000400:02000000:1.0:1788836272.182910:0:3597:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.138@tcp [8/256/0/180] 00008000:02000000:2.0:1788836276.414726:0:3747:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788836341.439541:0:5715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788836357.300866:0:6466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788836357.300872:0:6466:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788836357.300873:0:6466:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788836357.301195:0:6466:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d532b379 00000080:02000400:0.0:1788836357.301207:0:6466:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788836357.318560:0:6466:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788836357.318573:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788836357.318614:0:6466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000978bc936) 00000020:00000080:0.0:1788836357.318634:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788836357.431274:0:6466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788836357.431381:0:6466:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788836357.487288:0:6466:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836357.487507:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788836357.487527:0:6466:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836357.487539:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553aa8 00000020:01000004:3.0:1788836357.487545:0:6466:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788836357.487550:0:6466:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788836357.487554:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d532b379 from MGS 00000020:01000004:3.0:1788836357.487559:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788836357.487577:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000805d6337) 00000020:00000080:3.0:1788836357.487589:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788836357.487774:0:6466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d532b379 from MGS, refs=2 00080000:01000000:3.0:1788836357.487781:0:6466:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836357.487785:0:6466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553ab6 00000100:00100000:3.0:1788836357.487876:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788836357.488198:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788836357.488204:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788836357.496778:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788836357.496793:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788836357.497678:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836357.497874:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788836357.497879:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788836357.498890:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788836357.498900:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788836357.499634:0:6466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788836357.499642:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788836357.500353:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836357.500356:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836357.500358:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836357.500740:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836357.500743:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836357.500744:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836357.504769:0:6466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788836357.512349:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788836357.757410:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2399 MB/s 00000001:01000000:3.0:1788836358.008103:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3375 MB/s 00000001:01000000:0.0:1788836358.258946:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 531 MB/s 00000001:01000000:3.0:1788836358.509520:0:6466:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 587 MB/s 00080000:10000000:1.0:1788836358.516360:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788836358.526763:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788836358.540741:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788836358.541649:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788836358.541695:0:6466:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788836358.541731:0:6466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788836358.542297:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788836358.542324:0:6466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788836358.542760:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836358.544668:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788836358.544680:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788836358.545716:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788836358.545724:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788836358.546819:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788836358.546826:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788836358.547606:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788836358.547627:0:6466:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:1.0:1788836358.547630:0:6466:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788836358.547731:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:1.0:1788836358.547751:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (00000000f559d15a) 00000020:00000080:1.0:1788836358.547772:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788836358.547880:0:6466:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3e81d93@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836358.548172:0:6466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:1.0:1788836358.548181:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788836358.550124:0:6487:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788836358.550177:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb) 00000020:00000080:1.0:1788836358.550198:0:6466:0:(genops.c:1385:class_connect()) connect: client 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb, cookie 0xf7b38383a6553ac4 00000100:00080000:1.0:1788836358.550210:0:6466:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836358.550215:0:6466:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import 00000000f3e81d93 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836358.550258:0:6466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000608614f3 x1875730782748800/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836358.550281:0:6466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS 00000020:01000004:1.0:1788836358.550299:0:6466:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788836358.550309:0:6466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788836358.550321:0:6466:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005488c35b) 00000020:00000080:1.0:1788836358.550345:0:6466:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788836358.557832:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000608614f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782748800:0@lo:250: 00000100:00100000:3.0:1788836358.557893:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836358.558319:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782748800 00000100:00100000:1.0:1788836358.558338:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782748800 00000100:00100000:1.0:1788836358.558389:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836358.558398:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd191b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875730782748800:12345-0@lo:250: 00010000:00080000:1.0:1788836358.558432:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1788836358.558473:0:6483:0:(genops.c:1385:class_connect()) connect: client 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb, cookie 0xf7b38383a6553ad2 00000100:00080000:3.0:1788836358.558716:0:6486:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:1.0:1788836358.559123:0:6483:0:(import.c:65:import_set_state_nolock()) 00000000ce3a0181 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836358.559332:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd191b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:3613:x1875730782748800:12345-0@lo:250: Request processed in 933us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836358.559344:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836358.559440:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788836358.559452:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1788836358.559463:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788836358.559470:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788836358.559474:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000f3e81d93 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788836358.559477:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788836358.559481:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788836358.559486:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000608614f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782748800:0@lo:250: 00000100:00100000:0.0:1788836358.568678:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836358.569894:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788836358.569973:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788836358.575125:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836358.575140:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788836358.577478:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788836358.577493:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788836358.585787:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836358.586093:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788836358.586101:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788836358.590295:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788836358.590380:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788836358.658373:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836358.658633:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788836358.658641:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788836358.664574:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788836358.664588:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788836358.665641:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836358.665855:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836358.665861:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788836358.666550:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788836358.666557:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788836358.667206:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836358.667390:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836358.667396:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788836358.686350:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788836358.686367:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788836358.692630:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836358.692891:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788836358.692907:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788836358.701925:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788836358.701942:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788836358.738664:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836358.738934:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836358.738941:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788836358.747671:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836358.747687:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788836358.753849:0:6466:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836358.753866:0:6466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788836358.755063:0:6466:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788836358.755093:0:6466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788836358.755099:0:6466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788836358.755212:0:6466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836358.755245:0:6466:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788836358.755249:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836358.755250:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836358.755252:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836358.755253:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836358.755254:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836358.755255:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836358.755257:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836358.755258:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836358.755260:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836358.755261:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836358.755262:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836358.755263:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836358.755265:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788836358.755268:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836358.755269:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836358.755270:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836358.755271:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836358.755272:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836358.755272:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836358.755273:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836358.755274:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836358.755275:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836358.755276:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836358.755276:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836358.755283:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836358.755320:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788836358.755338:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079ecf60e pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782748928:0@lo:253: 00000100:00100000:2.0:1788836358.755401:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836358.755447:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc910c68 going to sleep for 11 seconds 00000100:00100000:0.0:1788836358.756990:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782748928 00000100:00100000:0.0:1788836358.757003:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782748928 00000100:00100000:0.0:1788836358.757095:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836358.757104:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c3f89c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6466:x1875730782748928:12345-0@lo:253: 20000000:01000000:0.0:1788836358.757161:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836358.757164:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788836358.758159:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788836358.758217:0:6485:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788836358.758482:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836358.767609:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788836358.768407:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836358.768412:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788836358.768418:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788836358.768421:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788836358.768431:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788836358.768660:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836358.768809:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788836358.768837:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788836358.768856:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788836358.768870:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788836358.768882:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788836358.768933:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788836358.768941:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788836358.768954:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788836358.768960:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788836358.768988:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788836358.768994:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788836358.769006:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788836358.769066:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788836358.769097:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788836358.769101:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788836358.769117:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836358.769215:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788836358.769225:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788836358.769240:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788836358.769255:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788836358.769266:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788836358.769274:0:6485:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788836358.769300:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788836358.769307:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788836358.769320:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788836358.769333:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788836358.769348:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788836358.769357:0:6485:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788836358.769378:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788836358.769385:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788836358.769398:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788836358.769413:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788836358.769460:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788836358.769477:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788836358.769482:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788836358.770425:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788836358.770858:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788836358.770884:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.138@tcp for mdt 20000000:01000000:2.0:1788836358.770886:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836358.770902:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788836358.770909:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788836358.770923:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788836358.770928:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836358.770941:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788836358.770947:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788836358.770959:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788836358.770973:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788836358.771003:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788836358.771006:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788836358.771039:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788836358.771104:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788836358.771107:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788836358.778123:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788836358.778392:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788836358.778423:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788836358.778438:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788836358.778448:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788836358.778451:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788836358.779059:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788836358.779221:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788836358.779242:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788836358.779255:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788836358.779267:0:6485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836358.779270:0:6485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788836358.779274:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788836358.779283:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788836358.779288:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788836358.779294:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788836358.779580:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788836358.779920:0:6485:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788836358.792325:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788836358.792374:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788836358.792388:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788836358.792412:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788836358.792439:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792461:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792473:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792480:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792487:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792507:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792512:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005bd60719 already unused, calling callback (000000009cfbf275) 00010000:00010000:0.0:1788836358.792515:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792544:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792558:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792567:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.792573:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005bd60719/0xf7b38383a6553ad9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836358.792597:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788836358.823489:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c3f89c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6466:x1875730782748928:12345-0@lo:253: Request processed in 66373us (68075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836358.823522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836358.823742:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079ecf60e pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782748928:0@lo:253: 10000000:01000000:2.0:1788836358.823776:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788836358.823780:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836358.823783:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836358.823784:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836358.823786:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788836358.823788:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836358.823789:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836358.823791:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836358.823792:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836358.823802:0:6466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788836358.823804:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836358.823805:0:6466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836358.823830:0:6466:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d532b379 from lustre-MDT0000 10000000:01000000:2.0:1788836358.824081:0:6466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788836358.824085:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788836358.824091:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8adf48a1cd28 10000000:01000000:2.0:1788836358.824095:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836358.824107:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adf48a1cd28 from 1 10000000:01000000:2.0:1788836358.824110:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788836358.824158:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.824170:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.824181:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836358.824201:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079ecf60e pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749056:0@lo:101: 00000100:00100000:2.0:1788836358.824250:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836358.824379:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a1c3983 going to sleep for 11 seconds 00000100:00100000:2.0:1788836358.833443:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749056 00000100:00100000:2.0:1788836358.833473:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749056 00000100:00100000:2.0:1788836358.833646:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836358.833657:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bedf677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6466:x1875730782749056:12345-0@lo:101: 00010000:00010000:2.0:1788836358.834814:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836358.834983:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ae0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.835057:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.835128:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.835147:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba56e060, rc 0) 00000100:00100000:2.0:1788836358.836725:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bedf677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:6466:x1875730782749056:12345-0@lo:101: Request processed in 3061us (12467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836358.836740:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836358.841032:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079ecf60e pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749056:0@lo:101: 00010000:00010000:3.0:1788836358.841958:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.841979:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836358.843588:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d90aa9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749184:0@lo:501: 00000100:00100000:3.0:1788836358.845362:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836358.845452:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009172ea6 going to sleep for 11 seconds 00000100:00100000:0.0:1788836358.845674:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749184 00000100:00100000:0.0:1788836358.845685:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749184 00000100:00100000:0.0:1788836358.845739:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836358.845748:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045e5e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:6466:x1875730782749184:12345-0@lo:501: 00000100:00100000:0.0:1788836358.845860:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045e5e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:6466:x1875730782749184:12345-0@lo:501: Request processed in 113us (505us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836358.845868:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836358.846003:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d90aa9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749184:0@lo:501: 10000000:01000000:3.0:1788836358.846294:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788836358.846315:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.846341:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836358.846351:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf50b59800 10000000:01000000:3.0:1788836358.846356:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836358.846360:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adf50b59800 10000000:01000000:3.0:1788836358.846362:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788836358.846365:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adf50b59800 from 1 10000000:01000000:3.0:1788836358.846429:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788836358.846464:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.846473:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.846481:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836358.846511:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d90aa9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749312:0@lo:101: 00000100:00100000:3.0:1788836358.846545:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836358.846581:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009172ea6 going to sleep for 11 seconds 00000100:00100000:2.0:1788836358.846659:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749312 00000100:00100000:2.0:1788836358.846665:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749312 00000100:00100000:2.0:1788836358.846705:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836358.846712:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b9b16c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:6466:x1875730782749312:12345-0@lo:101: 00010000:00010000:2.0:1788836358.846722:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836358.846734:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000854ef164/0xf7b38383a6553af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553aee expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.846755:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000854ef164/0xf7b38383a6553af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553aee expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.846765:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000854ef164/0xf7b38383a6553af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553aee expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836358.846773:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000854ef164, rc 0) 00000100:00100000:2.0:1788836358.846815:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b9b16c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+7:6466:x1875730782749312:12345-0@lo:101: Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836358.846822:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836358.846899:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d90aa9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749312:0@lo:101: 00010000:00010000:0.0:1788836358.846911:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.846920:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836358.846942:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788836358.846947:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.846953:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 0000000013a2cd6d/0xf7b38383a6553aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836358.846960:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788836358.846964:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836358.846968:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adf50b59800 10000000:01000000:0.0:1788836358.846971:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788836358.846975:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788836358.846977:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788836358.847005:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.847175:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.847183:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836358.847196:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749440:0@lo:101: 00000100:00100000:0.0:1788836358.847223:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836358.847254:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e81156ac going to sleep for 11 seconds 00000100:00100000:3.0:1788836358.847319:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749440 00000100:00100000:3.0:1788836358.847324:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749440 00000100:00100000:3.0:1788836358.847348:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836358.847354:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aecf85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+7:6466:x1875730782749440:12345-0@lo:101: 00010000:00010000:3.0:1788836358.847361:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836358.847564:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553afc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.847594:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553afc expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.847602:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553afc expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836358.847609:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004218c902, rc 0) 00000100:00100000:3.0:1788836358.847648:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aecf85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+8:6466:x1875730782749440:12345-0@lo:101: Request processed in 293us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836358.847654:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836358.847731:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749440:0@lo:101: 00010000:00010000:0.0:1788836358.847742:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836358.847759:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836358.847812:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749568:0@lo:501: 00000100:00100000:0.0:1788836358.847836:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836358.847858:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e81156ac going to sleep for 11 seconds 00000100:00100000:1.0:1788836358.847898:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749568 00000100:00100000:1.0:1788836358.847912:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749568 00000100:00100000:1.0:1788836358.847991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836358.848000:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f4e7c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+8:6466:x1875730782749568:12345-0@lo:501: 00000100:00100000:1.0:1788836358.848244:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f4e7c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6466:x1875730782749568:12345-0@lo:501: Request processed in 244us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836358.848329:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749568:0@lo:501: 00000100:00100000:0.0:1788836358.848373:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749696:0@lo:503: 00000100:00100000:0.0:1788836358.848724:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836358.848761:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e81156ac going to sleep for 11 seconds 00000100:00100000:2.0:1788836358.849339:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749696 00000100:00100000:2.0:1788836358.849348:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749696 00000100:00100000:1.0:1788836358.853586:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836358.854086:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836358.854120:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af573830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782749696:12345-0@lo:503: 00000100:00100000:2.0:1788836358.854447:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af573830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782749696:12345-0@lo:503: Request processed in 332us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836358.854456:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836358.854558:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782749696:0@lo:503: 00000100:00100000:3.0:1788836358.858958:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a978305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6512:1875730782749824:0@lo:502: 00000100:00100000:3.0:1788836358.859147:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836358.859289:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099911cd3 going to sleep for 11 seconds 00000100:00100000:1.0:1788836358.859462:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749824 00000100:00100000:1.0:1788836358.859471:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749824 00000100:00100000:1.0:1788836358.859567:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836358.859576:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a77274e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6512:x1875730782749824:12345-0@lo:502: 00000100:00100000:1.0:1788836358.859706:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a77274e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6512:x1875730782749824:12345-0@lo:502: Request processed in 132us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836358.859715:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836358.859811:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a978305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6512:1875730782749824:0@lo:502: 00000020:01000000:3.0:1788836358.859838:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836358.859849:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836358.859851:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836358.859856:0:6512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788836358.859859:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836358.859872:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a61dd16d) 00000020:00000080:3.0:1788836358.859888:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788836358.859894:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788836358.859970:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788836358.859977:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553b11 00000020:00000080:3.0:1788836358.860225:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788836358.860230:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836358.860233:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836358.860235:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836358.860245:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836358.860248:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836358.860250:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788836358.860253:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836358.860260:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000143b5e34) 00000020:00000080:3.0:1788836358.860269:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788836358.860273:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788836358.860275:0:6512:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788836358.860277:0:6512:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788836358.860283:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836358.860329:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d532b379 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788836358.860342:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000007a1d59c) 00000020:00000080:3.0:1788836358.860350:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788836358.860437:0:6512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788836358.860444:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553b26 00000020:00000080:3.0:1788836358.860547:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788836358.860553:0:6512:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788836358.860558:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7b38383a6553b2d 00080000:01000000:3.0:1788836358.860562:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788836358.860565:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553b34 00080000:10000000:3.0:1788836358.860974:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788836358.861394:0:6512:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788836358.871378:0:6512:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788836358.982177:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788836358.982472:0:6512:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788836358.993295:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788836358.993738:0:6512:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788836359.005318:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000025307526) 00000020:00000080:0.0:1788836359.005343:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788836359.005422:0:6512:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788836359.005429:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553b42 00000020:00000080:3.0:1788836359.007584:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788836359.008426:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788836359.011846:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788836359.024160:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788836359.028460:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788836359.033988:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788836359.037886:0:6512:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788836359.040624:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7b38383a6553b49 00000020:00000080:2.0:1788836359.041080:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788836359.041092:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836359.041099:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836359.041101:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788836359.041104:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836359.041108:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836359.041110:0:6512:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836359.041113:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836359.041114:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836359.041117:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836359.041120:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836359.041121:0:6512:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788836359.041123:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836359.041127:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836359.041128:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788836359.041132:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788836359.041172:0:6512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788836359.041231:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081ed994b pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6512:1875730782749952:0@lo:502: 00000100:00100000:2.0:1788836359.041310:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836359.041361:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 000000009338c468 going to sleep for 11 seconds 00000100:00100000:1.0:1788836359.041424:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782749952 00000100:00100000:1.0:1788836359.041432:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782749952 00000100:00100000:1.0:1788836359.041476:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836359.041483:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020efa13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6512:x1875730782749952:12345-0@lo:502: 00000100:00100000:1.0:1788836359.041615:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020efa13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6512:x1875730782749952:12345-0@lo:502: Request processed in 133us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836359.041624:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836359.041994:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081ed994b pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6512:1875730782749952:0@lo:502: 00000020:01000000:0.0:1788836359.042057:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836359.042063:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836359.042065:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788836359.042069:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788836359.042193:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788836359.042228:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836359.042241:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.042250:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836359.042259:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf50b59800 from 1 10000000:01000000:3.0:1788836359.042262:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836359.042288:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.042295:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.042303:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.042317:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a978305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750080:0@lo:101: 00000100:00100000:3.0:1788836359.042353:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.042383:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b218c80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836359.042446:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750080 00000100:00100000:2.0:1788836359.042451:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750080 00000100:00100000:2.0:1788836359.042482:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836359.042498:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffe594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:6466:x1875730782750080:12345-0@lo:101: 00010000:00010000:2.0:1788836359.042508:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836359.042524:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553b50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.042554:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.042563:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.042570:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cc07f2f, rc 0) 00000100:00100000:2.0:1788836359.042620:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffe594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782750080:12345-0@lo:101: Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836359.042626:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836359.043090:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a978305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750080:0@lo:101: 00010000:00010000:0.0:1788836359.043115:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.043124:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836359.043804:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750208:0@lo:256: 00000100:00100000:1.0:1788836359.044220:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836359.044261:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ebb4c5f going to sleep for 11 seconds 00000100:00100000:2.0:1788836359.044311:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750208 00000100:00100000:2.0:1788836359.044320:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750208 00000100:00100000:2.0:1788836359.044367:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836359.044374:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce7d8e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782750208:12345-0@lo:256: 20000000:01000000:2.0:1788836359.044392:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788836359.044398:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788836359.044483:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce7d8e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782750208:12345-0@lo:256: Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836359.044502:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836359.044626:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1473210 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750208:0@lo:256: 10000000:01000000:3.0:1788836359.045238:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836359.045254:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.045264:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836359.045272:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf50b59800 from 1 10000000:01000000:3.0:1788836359.045904:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836359.045940:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.045948:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.045956:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.045972:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750336:0@lo:101: 00000100:00100000:3.0:1788836359.046049:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.046080:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f96c58 going to sleep for 11 seconds 00000100:00100000:0.0:1788836359.047093:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750336 00000100:00100000:0.0:1788836359.047105:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750336 00000100:00100000:0.0:1788836359.047160:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836359.047168:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000550af921 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:6466:x1875730782750336:12345-0@lo:101: 00010000:00010000:0.0:1788836359.047182:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836359.047198:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553b5e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.047222:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.047231:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.047239:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065efdabe, rc 0) 00000100:00100000:0.0:1788836359.047302:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000550af921 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750336:12345-0@lo:101: Request processed in 135us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836359.047309:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836359.047609:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750336:0@lo:101: 00010000:00010000:3.0:1788836359.047626:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.047643:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.047736:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750464:0@lo:501: 00000100:00100000:3.0:1788836359.047768:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.047804:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f96c58 going to sleep for 11 seconds 00000100:00100000:1.0:1788836359.047858:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750464 00000100:00100000:1.0:1788836359.047863:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750464 00000100:00100000:1.0:1788836359.047896:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836359.047902:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059cfe4c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750464:12345-0@lo:501: 00000100:00100000:1.0:1788836359.048102:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059cfe4c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750464:12345-0@lo:501: Request processed in 200us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836359.048118:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836359.048392:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750464:0@lo:501: 00000100:00100000:3.0:1788836359.048419:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750592:0@lo:503: 00000100:00100000:3.0:1788836359.048453:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.048480:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053f96c58 going to sleep for 11 seconds 00000100:00100000:0.0:1788836359.048903:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750592 00000100:00100000:0.0:1788836359.048909:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750592 00000100:00100000:0.0:1788836359.048996:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836359.049004:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000782a0e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750592:12345-0@lo:503: 00000040:00080000:2.0:1788836359.049154:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836359.049206:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000782a0e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750592:12345-0@lo:503: Request processed in 203us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836359.049212:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836359.049286:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750592:0@lo:503: 00000040:00080000:3.0:1788836359.055007:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788836359.055113:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788836359.055137:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836359.055152:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.055165:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836359.055216:0:6466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836359.055219:0:6466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf50b59800 10000000:01000000:0.0:1788836359.055222:0:6466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf50b59800 10000000:01000000:0.0:1788836359.055225:0:6466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836359.055231:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf50b59800 from 1 10000000:01000000:0.0:1788836359.055234:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836359.055269:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.055278:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.055288:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836359.055310:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f373938f pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750720:0@lo:101: 00000100:00100000:0.0:1788836359.055381:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836359.055429:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 000000009572b82b going to sleep for 11 seconds 00000100:00100000:3.0:1788836359.055584:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750720 00000100:00100000:3.0:1788836359.055592:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750720 00000100:00100000:3.0:1788836359.055648:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836359.055657:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cc31313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6466:x1875730782750720:12345-0@lo:101: 00010000:00010000:3.0:1788836359.055670:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836359.055682:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553b6c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.055706:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.055715:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.055723:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb4a97c9, rc 0) 00000100:00100000:3.0:1788836359.055765:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cc31313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782750720:12345-0@lo:101: Request processed in 109us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.055771:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836359.056124:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f373938f pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750720:0@lo:101: 00010000:00010000:2.0:1788836359.056138:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.056165:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836359.056222:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051f83237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750848:0@lo:501: 00000100:00100000:2.0:1788836359.056250:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836359.056278:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc910c68 going to sleep for 11 seconds 00000100:00100000:3.0:1788836359.056333:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750848 00000100:00100000:3.0:1788836359.056337:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750848 00000100:00100000:3.0:1788836359.056370:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836359.056376:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077fb6b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782750848:12345-0@lo:501: 00000100:00100000:3.0:1788836359.056583:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077fb6b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782750848:12345-0@lo:501: Request processed in 206us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.056591:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836359.060508:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051f83237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750848:0@lo:501: 00000100:00100000:1.0:1788836359.060715:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000608614f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750976:0@lo:503: 00000100:00100000:1.0:1788836359.060798:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836359.060893:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6c253e1 going to sleep for 11 seconds 00000100:00100000:2.0:1788836359.066302:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782750976 00000100:00100000:2.0:1788836359.066319:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782750976 00000100:00100000:3.0:1788836359.066466:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836359.066477:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033e0592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782750976:12345-0@lo:503: 00000100:00100000:3.0:1788836359.066803:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033e0592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782750976:12345-0@lo:503: Request processed in 328us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.066811:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836359.066907:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000608614f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782750976:0@lo:503: 00000100:00100000:2.0:1788836359.068680:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6517:1875730782751104:0@lo:502: 00000100:00100000:2.0:1788836359.068754:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836359.068802:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d28df616 going to sleep for 11 seconds 00000100:00100000:3.0:1788836359.069057:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751104 00000100:00100000:3.0:1788836359.069064:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751104 00000100:00100000:3.0:1788836359.069109:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836359.069117:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afa55648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6517:x1875730782751104:12345-0@lo:502: 00000100:00100000:3.0:1788836359.069240:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afa55648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6517:x1875730782751104:12345-0@lo:502: Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.069247:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836359.069341:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6517:1875730782751104:0@lo:502: 00000020:01000004:2.0:1788836359.069403:0:6517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788836359.069431:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007994e7e1) 00000020:00000080:2.0:1788836359.069451:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788836359.069572:0:6517:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d532b379 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788836359.069577:0:6517:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d532b379 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788836359.069579:0:6517:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d532b379 4 00010000:00080000:2.0:1788836359.069607:0:6517:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000027b367e0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788836359.073757:0:6517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788836359.074145:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788836359.074203:0:6517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836359.074216:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7b38383a6553b81 00000100:00080000:3.0:1788836359.074226:0:6517:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836359.074231:0:6517:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027b367e0 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836359.074266:0:6517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d3cf36ff x1875730782751232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836359.074295:0:6517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788836359.074384:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782751232:0@lo:38: 00000100:00100000:1.0:1788836359.074455:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.074516:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6dd2013 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6517:1875730782751360:0@lo:502: 00000100:00100000:3.0:1788836359.074555:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.074698:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034d74bc2 going to sleep for 11 seconds 00000100:00100000:0.0:1788836359.075067:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751232 00000100:00100000:0.0:1788836359.075075:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751232 00000100:00100000:0.0:1788836359.075115:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836359.075122:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000608614f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782751232:12345-0@lo:38: 00000100:00100000:0.0:1788836359.075196:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000608614f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782751232:12345-0@lo:38: Request processed in 73us (740us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788836359.075203:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836359.075229:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836359.075237:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000027b367e0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836359.075241:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788836359.075244:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3cf36ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782751232:0@lo:38: 00000100:00100000:3.0:1788836359.075277:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751360 00000100:00100000:3.0:1788836359.075281:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751360 00000100:00100000:3.0:1788836359.075318:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836359.075325:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ec0b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6517:x1875730782751360:12345-0@lo:502: 00000100:00100000:3.0:1788836359.075445:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ec0b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6517:x1875730782751360:12345-0@lo:502: Request processed in 121us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.075452:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788836359.075641:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6dd2013 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6517:1875730782751360:0@lo:502: 00000040:00080000:1.0:1788836359.075663:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788836359.075918:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788836359.075938:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836359.075971:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.075981:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788836359.076058:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788836359.076060:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788836359.076061:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836359.076063:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836359.076064:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836359.076065:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836359.076066:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836359.076068:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788836359.076069:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836359.076070:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836359.076072:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836359.076073:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836359.076077:0:6466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788836359.076080:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836359.076081:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788836359.076082:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836359.076083:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836359.076084:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836359.076085:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836359.076085:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836359.076086:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788836359.076087:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836359.076088:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836359.076089:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836359.076090:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836359.076111:0:6466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788836359.076120:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000597f30d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782751488:0@lo:253: 00000100:00100000:0.0:1788836359.076152:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836359.076186:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5fe59bb going to sleep for 11 seconds 00000100:00100000:3.0:1788836359.076518:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751488 00000100:00100000:3.0:1788836359.076524:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751488 00000100:00100000:3.0:1788836359.076562:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788836359.076569:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d7599c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782751488:12345-0@lo:253: 20000000:01000000:3.0:1788836359.076589:0:6483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788836359.076603:0:6483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836359.095435:0:6483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836359.095455:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788836359.095564:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788836359.095569:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788836359.095591:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.095620:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.095633:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.095669:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.095687:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836359.095701:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782751616:0@lo:104: 00000100:00100000:1.0:1788836359.095760:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836359.095813:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6c253e1 going to sleep for 11 seconds 00000100:00100000:0.0:1788836359.095993:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751616 00000100:00100000:0.0:1788836359.096000:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751616 00000100:00100000:0.0:1788836359.096078:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836359.096087:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3af2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782751616:12345-0@lo:104: 00010000:00010000:0.0:1788836359.096099:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.096159:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836359.096164:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3af2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782751616:12345-0@lo:104: Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836359.096170:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836359.096433:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d7599c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6466:x1875730782751488:12345-0@lo:253: Request processed in 19864us (20279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836359.096441:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836359.096535:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000597f30d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6466:1875730782751488:0@lo:253: 00000100:00100000:1.0:1788836359.096535:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782751616:0@lo:104: 10000000:01000000:2.0:1788836359.096546:0:6466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788836359.096548:0:6466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836359.096550:0:6466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836359.096551:0:6466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836359.096552:0:6466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:1.0:1788836359.096552:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836359.096554:0:6466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836359.096555:0:6466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836359.096557:0:6466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836359.096565:0:6466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836359.096566:0:6466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836359.096568:0:6466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836359.096569:0:6466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836359.096570:0:6466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836359.096582:0:6466:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788836359.097067:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836359.097075:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.097084:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009be4d341 already unused, calling callback (000000009c9de97f) 10000000:00010000:0.0:1788836359.097087:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.097095:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836359.097109:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836359.097114:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836359.097149:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.097156:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836359.097177:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.097183:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b57 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.097199:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836359.097201:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836359.097202:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836359.097268:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000861f7bcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782751744:0@lo:103: 00000100:00100000:0.0:1788836359.097306:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836359.104786:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751744 00000100:00100000:3.0:1788836359.104802:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751744 00010000:00010000:3.0:1788836359.104858:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.104907:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836359.104924:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b01e6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3615:x1875730782751744:12345-0@lo:103: 00010000:00010000:3.0:1788836359.104938:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836359.104942:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.104952:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.104968:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cc07f2f/0xf7b38383a6553b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553b50 expref: 12 pid: 6483 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.104985:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.104992:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836359.105040:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009471915s 00010000:00010000:3.0:1788836359.105045:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105051:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105058:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105064:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105069:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca957239 already unused, calling callback (000000009cfbf275) 00010000:00010000:3.0:1788836359.105072:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105080:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105100:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836359.105111:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836359.105140:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.105148:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.105153:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca957239/0xf7b38383a6553b88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.105188:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b01e6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:3615:x1875730782751744:12345-0@lo:103: Request processed in 266us (7881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836359.105196:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836359.105268:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000861f7bcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782751744:0@lo:103: 00080000:10000000:2.0:1788836359.108887:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788836359.109322:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788836359.109588:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788836359.109759:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788836359.114744:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788836359.115082:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788836359.117578:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788836359.117842:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788836359.118432:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788836359.118747:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788836359.118953:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788836359.135927:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788836359.140097:0:6466:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788836359.162674:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788836359.162766:0:6522:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788836359.162777:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788836359.163407:0:6523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788836359.166707:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788836359.168287:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788836359.168711:0:6466:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788836359.168723:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788836359.169128:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836359.173311:0:6466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788836359.175008:0:6466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788836359.175299:0:6466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788836359.175580:0:6466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788836359.177650:0:6466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788836359.178813:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:1.0:1788836359.178928:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1788836359.190548:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788836359.190722:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788836359.190877:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788836359.191077:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788836359.191209:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788836359.191385:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788836359.191548:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788836359.191694:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788836359.191824:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788836359.191975:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788836359.192190:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788836359.192324:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788836359.192506:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788836359.192658:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788836359.192807:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788836359.193139:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788836359.193304:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788836359.193431:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788836359.195362:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788836359.195567:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788836359.195712:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788836359.195875:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788836359.195989:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788836359.196146:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788836359.196274:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788836359.196382:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788836359.196504:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788836359.196637:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788836359.196774:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788836359.196888:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788836359.196997:0:6466:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788836359.197214:0:6466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788836359.202296:0:6523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788836359.202415:0:6523:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788836359.202420:0:6523:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788836359.206044:0:6466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788836359.206091:0:6466:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2ab0155f988 00100000:10000000:0.0:1788836359.206100:0:6466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788836359.218377:0:6466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788836359.218403:0:6466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788836359.218434:0:6466:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788836359.223139:0:6466:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788836359.228477:0:6466:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836359.228845:0:6466:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788836359.554562:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836360.575112:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836361.600051:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836362.627569:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836363.648228:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836364.542372:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:1.0:1788836364.542501:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836364.542507:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf50b59800 from 3 10000000:01000000:1.0:1788836364.542512:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836364.542554:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836364.542569:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836364.542582:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836364.542608:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782752000:0@lo:101: 00000100:00100000:1.0:1788836364.542713:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836364.542774:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000248bb07a going to sleep for 11 seconds 00000100:00080000:0.0:1788836364.544812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788836364.544827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788836364.544831:0:37:0:(import.c:65:import_set_state_nolock()) 0000000027b367e0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836364.544849:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027b367e0 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836364.544902:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006e8dbacf x1875730782752128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836364.544983:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752000 00000100:00100000:0.0:1788836364.544994:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752000 00000100:00100000:0.0:1788836364.545096:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836364.545106:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f552b9b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:6487:x1875730782752000:12345-0@lo:101: 00010000:00010000:0.0:1788836364.545127:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836364.545150:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553b8f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836364.545197:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836364.545210:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836364.545220:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7c7e691, rc 0) 00000100:00100000:0.0:1788836364.546196:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f552b9b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6487:x1875730782752000:12345-0@lo:101: Request processed in 1085us (3477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836364.546208:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836364.546311:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782752000:0@lo:101: 00010000:00010000:0.0:1788836364.546338:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836364.546349:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836364.546466:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782752256:0@lo:256: 00000100:00100000:0.0:1788836364.546516:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836364.546554:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c86f0ff going to sleep for 11 seconds 00000100:00100000:0.0:1788836364.546574:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752256 00000100:00100000:0.0:1788836364.546579:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752256 00000100:00100000:0.0:1788836364.546614:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836364.546622:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9b88c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6487:x1875730782752256:12345-0@lo:256: 20000000:01000000:0.0:1788836364.546645:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836364.546665:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836364.546669:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788836364.547205:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9b88c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:6487:x1875730782752256:12345-0@lo:256: Request processed in 582us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836364.547213:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836364.547251:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782752256:0@lo:256: 10000000:01000000:0.0:1788836364.547938:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836364.547950:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836364.547960:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836364.548111:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e8dbacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782752128:0@lo:38: 00000100:00100000:1.0:1788836364.548170:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836364.549211:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752128 00000100:00100000:0.0:1788836364.549226:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752128 00000100:00100000:0.0:1788836364.549290:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836364.549298:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9d42c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875730782752128:12345-0@lo:38: 00010000:00080000:0.0:1788836364.549335:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1788836364.549388:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7b38383a6553b9d 00000004:00100000:0.0:1788836364.549462:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836364.549625:0:6492:0:(import.c:65:import_set_state_nolock()) 000000000c14f632 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836364.549731:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9d42c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875730782752128:12345-0@lo:38: Request processed in 431us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836364.549740:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836364.549802:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006e8dbacf x1875730782752128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836364.549821:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788836364.549832:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788836364.549839:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836364.549849:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000027b367e0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836364.549857:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e8dbacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782752128:0@lo:38: 00000100:00100000:2.0:1788836364.551388:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000861f7bcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782751872:0@lo:400: 00000100:00100000:2.0:1788836364.551475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836364.551777:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782751872 00000100:00100000:0.0:1788836364.551788:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782751872 00000100:00100000:0.0:1788836364.551851:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836364.551860:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9f0d0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782751872:12345-0@lo:400: 00000100:00100000:0.0:1788836364.551934:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9f0d0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782751872:12345-0@lo:400: Request processed in 74us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836364.551942:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788836364.552148:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000861f7bcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782751872:0@lo:400: 00010000:00010000:2.0:1788836364.674477:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836365.695743:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836365.721792:0:6768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788836366.720942:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836367.114765:0:6820:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836367.115199:0:6820:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836367.744221:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836368.767253:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836369.666492:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782752384:0@lo:400: 00000100:00100000:2.0:1788836369.666603:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836369.666692:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782752512:0@lo:400: 00000100:00100000:2.0:1788836369.666730:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836369.666781:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752384 00000100:00100000:2.0:1788836369.666790:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752384 00000100:00100000:2.0:1788836369.666859:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836369.666869:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8b034ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782752384:12345-0@lo:400: 00000100:00100000:2.0:1788836369.666930:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8b034ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782752384:12345-0@lo:400: Request processed in 61us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836369.666953:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836369.667001:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752512 00000100:00100000:2.0:1788836369.667005:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752512 00000100:00100000:2.0:1788836369.667078:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836369.667086:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031da423d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782752512:12345-0@lo:400: 00000100:00100000:2.0:1788836369.667128:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031da423d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782752512:12345-0@lo:400: Request processed in 44us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836369.667134:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788836369.667184:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee8bfbbb x1875730782752512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836369.667200:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782752512:0@lo:400: 00000100:00100000:2.0:1788836369.667231:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782752384:0@lo:400: 00010000:00010000:1.0:1788836369.791005:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836370.525983:0:6921:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836370.526444:0:6921:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836370.814378:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836371.841700:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836372.869226:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836373.892510:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836374.793274:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836374.793309:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e8dbacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782752640:0@lo:400: 00000100:00100000:0.0:1788836374.800055:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836374.800097:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782752768:0@lo:400: 00000100:00100000:0.0:1788836374.812550:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836374.822111:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752768 00000100:00100000:3.0:1788836374.822135:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752768 00000100:00100000:3.0:1788836374.822212:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836374.823729:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836374.823783:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752640 00000100:00100000:2.0:1788836374.823792:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752640 00000100:00100000:2.0:1788836374.823841:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836374.823852:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd036a3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3614:x1875730782752640:12345-0@lo:400: 00000100:00100000:2.0:1788836374.823922:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd036a3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3614:x1875730782752640:12345-0@lo:400: Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836374.823931:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836374.824110:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e8dbacf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782752640:0@lo:400: 00000100:00100000:3.0:1788836374.825745:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d1f4fa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782752768:12345-0@lo:400: 00000100:00100000:3.0:1788836374.825871:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d1f4fa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782752768:12345-0@lo:400: Request processed in 148us (13335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836374.825879:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836374.834232:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000094cbd48e x1875730782752768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836374.834258:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782752768:0@lo:400: 00010000:00010000:1.0:1788836374.910321:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836375.935362:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.972641:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836377.982254:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836379.010364:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836379.910158:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782752896:0@lo:400: 00000100:00100000:0.0:1788836379.910257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836379.910409:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782752896 00000100:00100000:1.0:1788836379.910417:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782752896 00000100:00100000:1.0:1788836379.910464:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836379.910470:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062f7cbea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782752896:12345-0@lo:400: 00000100:00100000:2.0:1788836379.910579:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782753024:0@lo:400: 00000100:00100000:2.0:1788836379.910624:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836379.910664:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753024 00000100:00100000:2.0:1788836379.910668:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753024 00000100:00100000:2.0:1788836379.910693:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836379.910698:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb16051c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782753024:12345-0@lo:400: 00000100:00100000:2.0:1788836379.910728:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb16051c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782753024:12345-0@lo:400: Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836379.910734:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788836379.910768:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee8bfbbb x1875730782753024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836379.910781:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782753024:0@lo:400: 00000100:00100000:1.0:1788836379.922341:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062f7cbea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:3617:x1875730782752896:12345-0@lo:400: Request processed in 11862us (12075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836379.922363:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836379.923356:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099f4cbc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782752896:0@lo:400: 00010000:00010000:3.0:1788836380.032149:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836381.055637:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836382.079007:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788836382.191862:0:7420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788836382.191876:0:7420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788836382.191878:0:7420:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788836382.192085:0:7420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c23c2d08 00000020:01000004:3.0:1788836382.192114:0:7420:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788836382.192127:0:7420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788836382.192155:0:7420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000a3ae8c99) 00000020:00000080:3.0:1788836382.192173:0:7420:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788836382.256906:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788836382.257063:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788836382.285933:0:7420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836382.286234:0:7420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788836382.286244:0:7420:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836382.286256:0:7420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553bab 00000020:01000004:3.0:1788836382.286263:0:7420:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788836382.286282:0:7420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836382.286286:0:7420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836382.286292:0:7420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788836382.286333:0:7420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788836382.286338:0:7420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836382.300886:0:7420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836382.300924:0:7420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788836382.300928:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836382.300930:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836382.300931:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836382.300932:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836382.300933:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836382.300935:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836382.300936:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836382.300937:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836382.300938:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836382.300940:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836382.300941:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836382.300944:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788836382.300946:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836382.300947:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836382.300948:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836382.300949:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836382.300954:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836382.300955:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836382.300956:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836382.300957:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836382.300957:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836382.300958:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836382.300959:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836382.300985:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788836382.301003:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782753152:0@lo:253: 00000100:00100000:3.0:1788836382.301124:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.301203:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adb9266e going to sleep for 11 seconds 00000100:00100000:3.0:1788836382.302123:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753152 00000100:00100000:3.0:1788836382.302136:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753152 00000100:00100000:3.0:1788836382.302204:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836382.302213:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000adf66a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782753152:12345-0@lo:253: 20000000:01000000:3.0:1788836382.302261:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788836382.302267:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788836382.302272:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788836382.302275:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788836382.302329:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788836382.302590:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836382.302722:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788836382.302744:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788836382.302762:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788836382.302776:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788836382.302788:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788836382.302847:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788836382.302860:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788836382.302875:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788836382.302883:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788836382.302895:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788836382.302900:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788836382.302912:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788836382.302944:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788836382.303135:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788836382.303147:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788836382.303161:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788836382.303167:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788836382.303182:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788836382.303188:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:3.0:1788836382.303200:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788836382.303205:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788836382.303216:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788836382.303229:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788836382.303238:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788836382.303311:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788836382.303322:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788836382.303336:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788836382.303352:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788836382.303369:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788836382.303375:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788836382.303388:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788836382.303405:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788836382.303411:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788836382.303432:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788836382.303438:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788836382.304496:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788836382.304832:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788836382.304872:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.138@tcp for mdt 20000000:01000000:2.0:1788836382.304875:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836382.304895:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788836382.304905:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788836382.304919:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788836382.304925:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836382.304945:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788836382.304955:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788836382.304974:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788836382.304998:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788836382.305141:0:6485:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788836382.305152:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788836382.305805:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788836382.306102:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788836382.306134:0:6485:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.138@tcp for mdt 20000000:01000000:0.0:1788836382.306138:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:0.0:1788836382.306158:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788836382.306175:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788836382.306202:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788836382.306209:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:0.0:1788836382.306224:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788836382.306232:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788836382.306259:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788836382.306278:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788836382.306313:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788836382.306317:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788836382.306321:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788836382.306382:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788836382.306384:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836382.306795:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836382.306824:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836382.306845:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788836382.307045:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788836382.307080:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788836382.307115:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788836382.307128:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788836382.307131:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836382.307553:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836382.307573:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836382.307673:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788836382.316695:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788836382.316736:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788836382.316762:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788836382.316781:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788836382.316784:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836382.318004:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836382.318368:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836382.318386:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788836382.318913:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788836382.318950:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788836382.318970:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788836382.318988:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788836382.318991:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788836382.318998:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788836382.319007:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788836382.321637:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788836382.321853:0:6485:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788836382.329518:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788836382.329546:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329565:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329569:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553afc expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329573:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329577:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329619:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329634:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.329647:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b108335 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753280:0@lo:104: 00000100:00100000:1.0:1788836382.329714:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836382.329782:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329804:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 12 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.329809:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753408:0@lo:104: 00000100:00100000:1.0:1788836382.329828:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836382.329855:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.329865:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 12 pid: 6484 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.329873:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753536:0@lo:104: 00000100:00100000:1.0:1788836382.329910:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.329923:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f55b4d7 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.330259:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753280 00000100:00100000:2.0:1788836382.330278:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753280 00000100:00100000:2.0:1788836382.330345:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753408 00000100:00100000:2.0:1788836382.330349:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753408 00000100:00100000:2.0:1788836382.330361:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753536 00000100:00100000:2.0:1788836382.330364:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753536 00000100:00100000:2.0:1788836382.330382:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836382.330391:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5166406 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6485:x1875730782753280:12345-0@lo:104: 00010000:00010000:2.0:1788836382.330413:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.330528:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836382.330534:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5166406 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6485:x1875730782753280:12345-0@lo:104: Request processed in 144us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.330542:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836382.330564:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836382.330569:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f3c1f18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6485:x1875730782753408:12345-0@lo:104: 00000100:00100000:0.0:1788836382.330571:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1788836382.330576:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836382.330582:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788836382.330621:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836382.330626:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f3c1f18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6485:x1875730782753408:12345-0@lo:104: Request processed in 57us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.330631:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788836382.330633:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836382.330639:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.330643:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788836382.330648:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a416d72 already unused, calling callback (000000009c9de97f) 10000000:00010000:3.0:1788836382.330651:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330659:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.330661:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024d4e89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6485:x1875730782753536:12345-0@lo:104: 10000000:00010000:3.0:1788836382.330667:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.330669:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.330674:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836382.330697:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836382.330700:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024d4e89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6485:x1875730782753536:12345-0@lo:104: Request processed in 41us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.330706:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788836382.330719:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330725:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836382.330754:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330761:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000005a416d72/0xf7b38383a6553b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b73 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330780:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836382.330782:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330789:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005bd60719 already unused, calling callback (000000009c9de97f) 10000000:00010000:3.0:1788836382.330797:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330804:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836382.330810:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.330816:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836382.330830:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330836:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836382.330852:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330858:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000005bd60719/0xf7b38383a6553afc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b03 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330866:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836382.330868:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330874:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000463b779a already unused, calling callback (000000009c9de97f) 10000000:00010000:3.0:1788836382.330876:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330881:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836382.330896:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.330902:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836382.330914:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330921:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836382.330925:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330931:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 00000000463b779a/0xf7b38383a6553ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ae7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.330947:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836382.330949:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836382.330950:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836382.330974:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efb0ea65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782753920:0@lo:103: 00000100:00100000:3.0:1788836382.331046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.331100:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836382.331107:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057b08be9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782753792:0@lo:103: 00000100:00100000:3.0:1788836382.331131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.331161:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753920 00000100:00100000:3.0:1788836382.331167:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753920 00010000:00010000:3.0:1788836382.331193:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 13 pid: 6484 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.331216:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753792 00000100:00100000:3.0:1788836382.331219:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753792 00010000:00010000:3.0:1788836382.331240:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 14 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.331255:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836382.331261:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005acdfaed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3617:x1875730782753920:12345-0@lo:103: 00010000:00010000:3.0:1788836382.331272:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836382.331277:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 14 pid: 6484 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331287:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 14 pid: 6484 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331306:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836382.331336:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005acdfaed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3617:x1875730782753920:12345-0@lo:103: Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.331342:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836382.331356:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836382.331362:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b835c6dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3617:x1875730782753792:12345-0@lo:103: 00000100:00100000:2.0:1788836382.331471:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000625ca546 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782753664:0@lo:103: 00000100:00100000:2.0:1788836382.331502:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836382.331552:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836382.331557:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 13 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331565:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 13 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331576:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836382.331598:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b835c6dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3617:x1875730782753792:12345-0@lo:103: Request processed in 237us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.331604:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836382.331624:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782753664 00000100:00100000:3.0:1788836382.331627:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782753664 00010000:00010000:3.0:1788836382.331638:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 13 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.331651:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836382.331656:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8bfbbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3615:x1875730782753664:12345-0@lo:103: 00010000:00010000:3.0:1788836382.331663:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836382.331666:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 13 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331673:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 13 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331687:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331696:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331711:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331729:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331736:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331741:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331757:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000050fab7f6 already unused, calling callback (000000009cfbf275) 00010000:00010000:3.0:1788836382.331761:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331768:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331778:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.331789:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836382.331820:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8bfbbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3615:x1875730782753664:12345-0@lo:103: Request processed in 164us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.331827:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836382.331910:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057b08be9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782753792:0@lo:103: 00000100:00100000:3.0:1788836382.331925:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efb0ea65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782753920:0@lo:103: 00010000:00010000:1.0:1788836382.332126:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553b6c expref: 12 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.332149:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b108335 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753280:0@lo:104: 00010000:00010000:1.0:1788836382.332168:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004218c902/0xf7b38383a6553b03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553afc expref: 11 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.332175:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753408:0@lo:104: 00010000:00010000:1.0:1788836382.332185:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba56e060/0xf7b38383a6553ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ae0 expref: 10 pid: 6484 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.332196:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1875730782753536:0@lo:104: 00010000:00010000:1.0:1788836382.332226:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.332244:0:6485:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.332249:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.332254:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836382.332273:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788836382.332344:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000625ca546 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782753664:0@lo:103: 00010000:00010000:0.0:1788836382.332611:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836382.341665:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000adf66a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:7420:x1875730782753152:12345-0@lo:253: Request processed in 39441us (40530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836382.341684:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836382.341787:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782753152:0@lo:253: 10000000:01000000:3.0:1788836382.341807:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788836382.341811:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836382.341815:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836382.341816:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836382.341818:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788836382.341819:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836382.341821:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836382.341822:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836382.341824:0:7420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788836382.341825:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836382.341826:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836382.341852:0:7420:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c23c2d08 from lustre-MDT0001 10000000:01000000:3.0:1788836382.341892:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788836382.341912:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788836382.341921:0:7420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adf48a1cd28 local copy 10000000:01000000:3.0:1788836382.341927:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836382.341974:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.341985:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.341995:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.342200:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754048:0@lo:101: 00000100:00100000:3.0:1788836382.342242:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.342311:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 000000002557acd1 going to sleep for 11 seconds 00000100:00100000:1.0:1788836382.342343:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754048 00000100:00100000:1.0:1788836382.342351:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754048 00000100:00100000:1.0:1788836382.342516:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836382.342526:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b04fcbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+9:7420:x1875730782754048:12345-0@lo:101: 00010000:00010000:1.0:1788836382.342541:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836382.342558:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553bb9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.342585:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553bb9 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.342596:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553bb9 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.342607:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050fab7f6, rc 0) 00000100:00100000:1.0:1788836382.342649:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b04fcbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:7420:x1875730782754048:12345-0@lo:101: Request processed in 125us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836382.342663:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836382.342726:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754048:0@lo:101: 00010000:00010000:3.0:1788836382.342739:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.342747:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.342863:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754176:0@lo:501: 00000100:00100000:3.0:1788836382.342887:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.342980:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 000000002557acd1 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.343151:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754176 00000100:00100000:2.0:1788836382.343157:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754176 00000100:00100000:2.0:1788836382.343184:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836382.343189:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069634cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:7420:x1875730782754176:12345-0@lo:501: 00000100:00100000:2.0:1788836382.343264:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069634cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:7420:x1875730782754176:12345-0@lo:501: Request processed in 75us (377us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836382.343271:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836382.343340:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754176:0@lo:501: 10000000:01000000:3.0:1788836382.343354:0:7420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788836382.343382:0:7420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788836382.343388:0:7420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.343405:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.343412:0:7420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.343440:0:7420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836382.343472:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf444f2000 10000000:01000000:3.0:1788836382.343478:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836382.343484:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8adf48a1cd28 10000000:01000000:3.0:1788836382.343486:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788836382.343490:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8adf48a1cd28 from 1 10000000:01000000:3.0:1788836382.343493:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788836382.343512:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.343520:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.343528:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.343541:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754304:0@lo:101: 00000100:00100000:3.0:1788836382.343567:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.343587:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.343634:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754304 00000100:00100000:2.0:1788836382.343638:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754304 00000100:00100000:2.0:1788836382.343652:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836382.343657:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e7a2f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:7420:x1875730782754304:12345-0@lo:101: 00010000:00010000:2.0:1788836382.343664:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.343675:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba56e060/0xf7b38383a6553bce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553bc7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343688:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba56e060/0xf7b38383a6553bce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553bc7 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343703:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba56e060/0xf7b38383a6553bce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553bc7 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343710:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba56e060, rc 0) 00000100:00100000:2.0:1788836382.343742:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e7a2f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:7420:x1875730782754304:12345-0@lo:101: Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.343748:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788836382.343769:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836382.343776:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343785:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009be4d341 already unused, calling callback (000000009c9de97f) 10000000:00010000:2.0:1788836382.343788:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343796:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836382.343803:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836382.343808:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836382.343825:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343831:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836382.343847:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343862:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000009be4d341/0xf7b38383a6553bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553bc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.343879:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836382.343881:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836382.343882:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836382.343891:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782754432:0@lo:103: 00000100:00100000:2.0:1788836382.343918:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.343958:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754432 00000100:00100000:2.0:1788836382.343962:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754432 00000100:00100000:2.0:1788836382.343992:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836382.343997:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052c9b626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:3614:x1875730782754432:12345-0@lo:103: 00010000:00010000:2.0:1788836382.344007:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836382.344047:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000050fab7f6/0xf7b38383a6553bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553bb9 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344059:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836382.344082:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052c9b626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:3614:x1875730782754432:12345-0@lo:103: Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.344100:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836382.344125:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782754432:0@lo:103: 00000100:00100000:3.0:1788836382.344191:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754304:0@lo:101: 00010000:00010000:3.0:1788836382.344200:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344217:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.344231:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788836382.344247:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344254:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000a97fcb3c/0xf7b38383a6553bc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.344262:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adf444f2000 10000000:01000000:3.0:1788836382.344265:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788836382.344269:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adf444f2000 from 1 10000000:01000000:3.0:1788836382.344270:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788836382.344282:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344289:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344296:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.344306:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754560:0@lo:101: 00000100:00100000:3.0:1788836382.344328:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.344344:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.344396:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754560 00000100:00100000:2.0:1788836382.344400:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754560 00000100:00100000:2.0:1788836382.344417:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836382.344421:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014ee737b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+10:7420:x1875730782754560:12345-0@lo:101: 00010000:00010000:2.0:1788836382.344428:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.344439:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000463b779a/0xf7b38383a6553bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553bd5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344452:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000463b779a/0xf7b38383a6553bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553bd5 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344459:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000463b779a/0xf7b38383a6553bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553bd5 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344466:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000463b779a, rc 0) 00000100:00100000:2.0:1788836382.344498:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014ee737b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:7420:x1875730782754560:12345-0@lo:101: Request processed in 77us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.344502:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836382.344553:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754560:0@lo:101: 00010000:00010000:3.0:1788836382.344562:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344573:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.344583:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788836382.344594:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344600:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000004edb62d3/0xf7b38383a6553bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836382.344606:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788836382.344609:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836382.344613:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adf444f2000 10000000:01000000:3.0:1788836382.344615:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788836382.344618:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788836382.344619:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788836382.344631:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344637:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344643:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.344651:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754688:0@lo:101: 00000100:00100000:3.0:1788836382.344672:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.344681:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.344724:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754688 00000100:00100000:2.0:1788836382.344727:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754688 00000100:00100000:2.0:1788836382.344741:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836382.344745:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec02735d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+11:7420:x1875730782754688:12345-0@lo:101: 00010000:00010000:2.0:1788836382.344751:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.344758:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9abacce/0xf7b38383a6553bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553be3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344768:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9abacce/0xf7b38383a6553bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344775:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9abacce/0xf7b38383a6553bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.344781:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9abacce, rc 0) 00000100:00100000:2.0:1788836382.344809:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec02735d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782754688:12345-0@lo:101: Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.344822:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836382.344871:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754688:0@lo:101: 00010000:00010000:3.0:1788836382.344880:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.344886:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.344966:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754816:0@lo:501: 00000100:00100000:3.0:1788836382.344989:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.345007:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.345162:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754816 00000100:00100000:2.0:1788836382.345167:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754816 00000100:00100000:2.0:1788836382.345182:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836382.345186:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf130215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782754816:12345-0@lo:501: 00000100:00100000:2.0:1788836382.345292:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf130215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782754816:12345-0@lo:501: Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.345298:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836382.345349:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754816:0@lo:501: 00000100:00100000:3.0:1788836382.345385:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754944:0@lo:503: 00000100:00100000:3.0:1788836382.345424:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.345449:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.345482:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782754944 00000100:00100000:2.0:1788836382.345486:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782754944 00000100:00100000:2.0:1788836382.345499:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836382.345503:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6fb91f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782754944:12345-0@lo:503: 00000100:00100000:2.0:1788836382.345579:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6fb91f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782754944:12345-0@lo:503: Request processed in 75us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.345586:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836382.345670:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782754944:0@lo:503: 00000040:00080000:3.0:1788836382.345966:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836382.346095:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755072:0@lo:502: 00000100:00100000:3.0:1788836382.346126:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.346147:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.346294:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755072 00000100:00100000:2.0:1788836382.346299:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755072 00000100:00100000:2.0:1788836382.346316:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836382.346321:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e633995f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782755072:12345-0@lo:502: 00000100:00100000:2.0:1788836382.346416:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e633995f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782755072:12345-0@lo:502: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.346423:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836382.346656:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755072:0@lo:502: 00000040:00080000:3.0:1788836382.346847:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788836382.346871:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788836382.346882:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788836382.346893:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788836382.346904:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788836382.346916:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788836382.346927:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788836382.346945:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788836382.346956:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788836382.346966:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788836382.346977:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788836382.346988:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788836382.347000:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788836382.347047:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788836382.347061:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788836382.347073:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788836382.347083:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788836382.347109:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788836382.347122:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788836382.347147:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788836382.347160:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788836382.347170:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788836382.347182:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788836382.347208:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755200:0@lo:502: 00000100:00100000:3.0:1788836382.347253:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.347285:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000581aaa4e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.347353:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755200 00000100:00100000:2.0:1788836382.347360:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755200 00000100:00100000:2.0:1788836382.347385:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836382.347392:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87c4981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782755200:12345-0@lo:502: 00000100:00100000:2.0:1788836382.347499:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87c4981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782755200:12345-0@lo:502: Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.347506:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836382.347651:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755200:0@lo:502: 00000040:00080000:3.0:1788836382.347693:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788836382.347701:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788836382.348445:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836382.348461:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836382.348464:0:7433:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788836382.348470:0:7433:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788836382.348473:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836382.348491:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a74e43b7) 00000020:00000080:3.0:1788836382.348518:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788836382.348525:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788836382.348621:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836382.348634:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553bf8 00000020:00000080:3.0:1788836382.348896:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788836382.348901:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836382.348904:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836382.348906:0:7433:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788836382.348909:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836382.348912:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836382.348913:0:7433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788836382.348917:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836382.348926:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000023c8b75c) 00000020:00000080:3.0:1788836382.348939:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788836382.348943:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788836382.348944:0:7433:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788836382.348948:0:7433:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788836382.348954:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836382.349060:0:7433:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c23c2d08 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788836382.349080:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000b06c7e31) 00000020:00000080:3.0:1788836382.349100:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788836382.349183:0:7433:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788836382.349188:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553c0d 00000020:00000080:3.0:1788836382.349282:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788836382.349289:0:7433:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788836382.349294:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf7b38383a6553c14 00080000:01000000:3.0:1788836382.349300:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788836382.349303:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553c1b 00080000:10000000:3.0:1788836382.349768:0:7433:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788836382.349900:0:7433:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788836382.475842:0:7433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788836382.476257:0:7433:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788836382.482425:0:7433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788836382.482904:0:7433:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788836382.506720:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788836382.506736:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836382.506746:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836382.506748:0:7433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788836382.506751:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836382.506757:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836382.506759:0:7433:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788836382.506761:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836382.506766:0:7433:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:00000080:2.0:1788836382.506797:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836382.506814:0:7433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000016adbff2) 00000020:00000080:2.0:1788836382.506843:0:7433:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788836382.506851:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836382.506956:0:7433:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788836382.506964:0:7433:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788836382.506971:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553c29 00010000:00080000:2.0:1788836382.507006:0:7433:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000de31ab46@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788836382.513964:0:7433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788836382.516320:0:7433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836382.516335:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788836382.516391:0:7433:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788836382.516414:0:7433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553c30 00000100:00080000:0.0:1788836382.516424:0:7433:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836382.516429:0:7433:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000de31ab46 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836382.516690:0:7433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008dc2bcb0 x1875730782755328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836382.516735:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dc2bcb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782755328:0@lo:38: 00000100:00100000:0.0:1788836382.516814:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836382.516988:0:7433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788836382.517105:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836382.517111:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517114:0:7433:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788836382.517118:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836382.517121:0:7433:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788836382.517123:0:7433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836382.517125:0:7433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836382.517127:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836382.517130:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517132:0:7433:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836382.517136:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836382.517140:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517143:0:7433:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788836382.517148:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788836382.517187:0:7433:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788836382.517201:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836382.517205:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517206:0:7433:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788836382.517209:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836382.517213:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517215:0:7433:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836382.517221:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836382.517223:0:7433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788836382.517253:0:7433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836382.517257:0:7433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836382.517259:0:7433:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788836382.517263:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1788836382.517849:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788836382.517887:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788836382.517914:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.517940:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000004218c902/0xf7b38383a6553be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836382.517948:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf444f2000 from 1 10000000:01000000:2.0:1788836382.517951:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836382.517981:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.517987:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.517997:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.518048:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755456:0@lo:101: 00000100:00100000:2.0:1788836382.518115:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.518151:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000248bb07a going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.518178:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755456 00000100:00100000:2.0:1788836382.518185:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755456 00000100:00100000:2.0:1788836382.518235:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836382.518246:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d8135aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+12:7420:x1875730782755456:12345-0@lo:101: 00010000:00010000:2.0:1788836382.518260:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.518273:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553c37 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.518296:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.518306:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.518322:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fe84e28, rc 0) 00000100:00100000:2.0:1788836382.518360:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d8135aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:7420:x1875730782755456:12345-0@lo:101: Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.518366:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836382.518427:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755456:0@lo:101: 00010000:00010000:2.0:1788836382.518449:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.518457:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.520753:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755584:0@lo:256: 00000100:00100000:2.0:1788836382.520865:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.520949:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000248bb07a going to sleep for 11 seconds 00000100:00100000:0.0:1788836382.521206:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb3a9aa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782755712:0@lo:400: 00000100:00100000:0.0:1788836382.521264:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.521446:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755712 00000100:00100000:3.0:1788836382.521458:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755712 00000100:00100000:1.0:1788836382.521556:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755584 00000100:00100000:1.0:1788836382.521571:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755584 00000100:00100000:1.0:1788836382.521649:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836382.521658:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836382.521665:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f6d662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:7420:x1875730782755584:12345-0@lo:256: 00000100:00100000:3.0:1788836382.521675:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfc2f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782755712:12345-0@lo:400: 20000000:01000000:1.0:1788836382.521767:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788836382.521800:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788836382.521805:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788836382.521814:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfc2f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782755712:12345-0@lo:400: Request processed in 143us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.521834:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836382.521864:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755328 00000100:00100000:3.0:1788836382.521869:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755328 00000100:00100000:3.0:1788836382.521909:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836382.521916:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8db30a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782755328:12345-0@lo:38: 00010000:00080000:3.0:1788836382.521946:0:6495:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000100:00100000:1.0:1788836382.521986:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f6d662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:7420:x1875730782755584:12345-0@lo:256: Request processed in 326us (1119us total) trans 0 rc 0/0 00000020:00000080:3.0:1788836382.521995:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553c45 00000100:00100000:1.0:1788836382.522000:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00100000:3.0:1788836382.522044:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788836382.522051:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788836382.522245:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755584:0@lo:256: 10000000:01000000:2.0:1788836382.522836:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836382.522866:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.522878:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836382.522887:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf444f2000 from 1 10000000:01000000:2.0:1788836382.522890:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836382.522921:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.522940:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.522949:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.522966:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755840:0@lo:101: 00000100:00100000:2.0:1788836382.523008:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.523063:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000248bb07a going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.523099:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755840 00000100:00100000:2.0:1788836382.523103:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755840 00000100:00100000:2.0:1788836382.523140:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836382.523146:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028add952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:7420:x1875730782755840:12345-0@lo:101: 00010000:00010000:2.0:1788836382.523157:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.523183:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553c4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.523204:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.523214:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.523223:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a696508a, rc 0) 00000100:00100000:2.0:1788836382.523256:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028add952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782755840:12345-0@lo:101: Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.523262:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836382.523301:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755840:0@lo:101: 00010000:00010000:2.0:1788836382.523320:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.523328:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.523428:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755968:0@lo:501: 00000100:00100000:2.0:1788836382.523460:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.523472:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000248bb07a going to sleep for 11 seconds 00000100:00100000:1.0:1788836382.523797:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782755968 00000100:00100000:1.0:1788836382.523811:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782755968 00000100:00100000:1.0:1788836382.523878:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836382.523887:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da181f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782755968:12345-0@lo:501: 00000100:00100000:1.0:1788836382.524118:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da181f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782755968:12345-0@lo:501: Request processed in 232us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836382.524126:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836382.524251:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782755968:0@lo:501: 00000100:00100000:1.0:1788836382.524300:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756096:0@lo:503: 00000100:00100000:1.0:1788836382.524354:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.524438:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce19a6e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.526176:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756096 00000100:00100000:2.0:1788836382.526192:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756096 00000100:00100000:2.0:1788836382.526253:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836382.526263:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a503b731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782756096:12345-0@lo:503: 00000040:00080000:2.0:1788836382.526337:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836382.526415:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a503b731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782756096:12345-0@lo:503: Request processed in 155us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.526421:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836382.526548:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756096:0@lo:503: 00010000:00080000:0.0:1788836382.526876:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb3a9aa1 x1875730782755712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836382.526890:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb3a9aa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782755712:0@lo:400: 00000040:00080000:1.0:1788836382.527964:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836382.528098:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788836382.528225:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836382.531849:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788836382.533762:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788836382.533814:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836382.533894:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.533908:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836382.533971:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788836382.533974:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf444f2000 10000000:01000000:1.0:1788836382.533977:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf444f2000 10000000:01000000:1.0:1788836382.533981:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836382.533988:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf444f2000 from 1 10000000:01000000:1.0:1788836382.533991:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836382.534059:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.534067:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.534077:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.534109:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756224:0@lo:101: 00000100:00100000:1.0:1788836382.534175:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.534221:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc232e72 going to sleep for 11 seconds 00000100:00100000:3.0:1788836382.534288:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756224 00000100:00100000:3.0:1788836382.534297:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756224 00000100:00100000:3.0:1788836382.534347:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836382.534357:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d82b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:7420:x1875730782756224:12345-0@lo:101: 00010000:00010000:3.0:1788836382.534371:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836382.534383:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553c5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.534404:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.534414:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb4a97c9/0xf7b38383a6553c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.534422:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb4a97c9, rc 0) 00000100:00100000:3.0:1788836382.534461:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d82b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756224:12345-0@lo:101: Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.534468:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836382.534757:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756224:0@lo:101: 00010000:00010000:1.0:1788836382.534772:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.534793:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.534905:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756352:0@lo:501: 00000100:00100000:1.0:1788836382.534932:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.534958:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc232e72 going to sleep for 11 seconds 00000100:00100000:3.0:1788836382.535264:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756352 00000100:00100000:3.0:1788836382.535269:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756352 00000100:00100000:3.0:1788836382.535301:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836382.535307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d961732b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756352:12345-0@lo:501: 00000100:00100000:3.0:1788836382.535419:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d961732b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756352:12345-0@lo:501: Request processed in 112us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.535427:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836382.539820:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756352:0@lo:501: 00000100:00100000:1.0:1788836382.539887:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756480:0@lo:503: 00000100:00100000:1.0:1788836382.539965:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.540227:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc232e72 going to sleep for 11 seconds 00000100:00080000:0.0:1788836382.541152:0:6495:0:(import.c:65:import_set_state_nolock()) 00000000b196dfab : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836382.541233:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8db30a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782755328:12345-0@lo:38: Request processed in 19317us (24419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836382.541249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836382.541377:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836382.541386:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788836382.541396:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788836382.541401:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836382.541403:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000de31ab46 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836382.541422:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dc2bcb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782755328:0@lo:38: 00000100:00100000:3.0:1788836382.541706:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836382.541719:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782756608:0@lo:41: 00000100:00100000:3.0:1788836382.541757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.543989:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756480 00000100:00100000:2.0:1788836382.544004:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756480 00000100:00100000:0.0:1788836382.544073:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756608 00000100:00100000:0.0:1788836382.544078:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756608 00000100:00100000:0.0:1788836382.544146:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836382.544155:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efb0ea65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730782756608:12345-0@lo:41: 00000004:00000024:0.0:1788836382.544192:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788836382.544270:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efb0ea65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730782756608:12345-0@lo:41: Request processed in 116us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836382.544278:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836382.544399:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782756608:0@lo:41: 00000100:00100000:2.0:1788836382.545279:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836382.545289:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016dbb4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756480:12345-0@lo:503: 00000100:00100000:2.0:1788836382.545450:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016dbb4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756480:12345-0@lo:503: Request processed in 162us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.545458:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836382.545544:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756480:0@lo:503: 00000040:00080000:1.0:1788836382.545867:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836382.545956:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756736:0@lo:502: 00000100:00100000:1.0:1788836382.546003:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.546514:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc232e72 going to sleep for 11 seconds 00000100:00100000:3.0:1788836382.547650:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756736 00000100:00100000:3.0:1788836382.547661:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756736 00000100:00100000:3.0:1788836382.547708:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788836382.547714:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086130c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756736:12345-0@lo:502: 00000100:00100000:3.0:1788836382.548226:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086130c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756736:12345-0@lo:502: Request processed in 510us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.548234:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836382.548627:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756736:0@lo:502: 00000040:00080000:1.0:1788836382.548842:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788836382.548874:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788836382.548892:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788836382.548902:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788836382.548912:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788836382.548922:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788836382.548932:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788836382.548942:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788836382.548952:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788836382.548961:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788836382.548971:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788836382.548982:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788836382.548995:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788836382.549008:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788836382.549207:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788836382.549222:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788836382.549235:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788836382.549247:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788836382.549260:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788836382.549271:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788836382.549282:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788836382.549295:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788836382.549307:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788836382.549713:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788836382.549738:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788836382.549749:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788836382.549759:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788836382.549769:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788836382.549803:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756864:0@lo:502: 00000100:00100000:1.0:1788836382.549861:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.549949:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc232e72 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.549990:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756864 00000100:00100000:2.0:1788836382.549997:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756864 00000100:00100000:2.0:1788836382.550187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836382.550196:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007db79c6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756864:12345-0@lo:502: 00000100:00100000:2.0:1788836382.550307:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007db79c6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782756864:12345-0@lo:502: Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.550315:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836382.550376:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782756864:0@lo:502: 00000040:00080000:1.0:1788836382.550415:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788836382.550426:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788836382.550890:0:7439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788836382.550904:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007022fd7a) 00000020:00000080:1.0:1788836382.550921:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788836382.550997:0:7439:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c23c2d08 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788836382.551001:0:7439:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c23c2d08 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788836382.551003:0:7439:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c23c2d08 3 00010000:00080000:1.0:1788836382.551058:0:7439:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007ec34459@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836382.555257:0:7439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788836382.555837:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788836382.555881:0:7439:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836382.555893:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf7b38383a6553c6f 00000100:00080000:1.0:1788836382.555902:0:7439:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836382.555906:0:7439:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000007ec34459 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836382.555937:0:7439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000181cacde x1875730782756992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836382.555960:0:7439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788836382.557424:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782756992:0@lo:38: 00000100:00100000:2.0:1788836382.557510:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788836382.557717:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788836382.557769:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788836382.557796:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836382.557811:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.557822:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000c9c7456d/0xf7b38383a6553c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788836382.557878:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788836382.557880:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788836382.557882:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836382.557886:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836382.557887:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836382.557888:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836382.557889:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836382.557891:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836382.557892:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836382.557893:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836382.557894:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836382.557898:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788836382.557900:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836382.557901:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788836382.557902:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836382.557902:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836382.557903:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836382.557904:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836382.557905:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836382.557905:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836382.557906:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836382.557907:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836382.557908:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836382.557930:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788836382.557940:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096e2b0ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782757120:0@lo:253: 00000100:00100000:0.0:1788836382.557984:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836382.557999:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc14015e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.558411:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757120 00000100:00100000:2.0:1788836382.558419:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757120 00000100:00100000:2.0:1788836382.558466:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788836382.558475:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a25c4df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782757120:12345-0@lo:253: 20000000:01000000:2.0:1788836382.558500:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788836382.558512:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1788836382.558652:0:7440:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1788836382.558661:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782756992 00000100:00100000:3.0:1788836382.558666:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782756992 00000100:00100000:3.0:1788836382.558689:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836382.558693:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b6ede7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782756992:12345-0@lo:38: 00010000:00080000:3.0:1788836382.558713:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1788836382.558749:0:6491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf7b38383a6553c76 00000004:00100000:3.0:1788836382.558766:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788836382.558796:0:6491:0:(import.c:65:import_set_state_nolock()) 000000004367921a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836382.558863:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b6ede7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875730782756992:12345-0@lo:38: Request processed in 168us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.558878:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788836382.558934:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000181cacde x1875730782756992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836382.558945:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836382.558955:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788836382.558962:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788836382.558967:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000001:00100000:3.0:1788836382.560695:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788836382.560779:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836382.560802:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788836382.561105:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836382.561111:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836382.561132:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561150:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561158:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561164:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561206:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561219:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 15 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.561232:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782757248:0@lo:104: 00000100:00100000:3.0:1788836382.561294:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836382.561339:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.561346:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 15 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.561372:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003debc757 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782757376:0@lo:104: 00000100:00100000:3.0:1788836382.561391:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.561408:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000000594cd44 going to sleep for 11 seconds 00000100:00100000:0.0:1788836382.563195:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757248 00000100:00100000:0.0:1788836382.563207:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757248 00000100:00100000:0.0:1788836382.563251:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757376 00000100:00100000:0.0:1788836382.563255:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757376 00000100:00100000:0.0:1788836382.563272:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836382.563279:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b08be9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782757248:12345-0@lo:104: 00010000:00010000:0.0:1788836382.563296:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563376:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836382.563387:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782757248:0@lo:104: 00000100:00100000:0.0:1788836382.563387:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b08be9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782757248:12345-0@lo:104: Request processed in 108us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836382.563394:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836382.563410:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836382.563415:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f50f8aca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782757376:12345-0@lo:104: 00010000:00010000:0.0:1788836382.563422:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563469:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836382.563473:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f50f8aca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782757376:12345-0@lo:104: Request processed in 59us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836382.563479:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788836382.563498:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836382.563503:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563510:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8d6ab84 already unused, calling callback (000000009c9de97f) 10000000:00010000:0.0:1788836382.563514:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563521:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836382.563528:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836382.563533:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836382.563563:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563580:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836382.563597:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563604:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 00000000a8d6ab84/0xf7b38383a6553c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c3e expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563616:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836382.563619:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563625:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cabcf241 already unused, calling callback (000000009c9de97f) 10000000:00010000:0.0:1788836382.563627:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563633:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836382.563639:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836382.563643:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836382.563654:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836382.563660:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836382.563671:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.563677:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a25c4df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7420:x1875730782757120:12345-0@lo:253: Request processed in 5204us (5704us total) trans 0 rc 0/0 00010000:00010000:0.0:1788836382.563677:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 00000000cabcf241/0xf7b38383a6553b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b96 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.563685:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788836382.563695:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836382.563696:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836382.563697:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836382.563704:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836382.563716:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fadab9e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782757504:0@lo:103: 00000100:00100000:1.0:1788836382.563722:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096e2b0ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7420:1875730782757120:0@lo:253: 10000000:01000000:1.0:1788836382.563732:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788836382.563735:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836382.563737:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788836382.563738:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836382.563740:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836382.563741:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836382.563742:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836382.563743:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836382.563744:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000100:00100000:0.0:1788836382.563746:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788836382.563751:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836382.563753:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836382.563754:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788836382.563768:0:7420:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788836382.563782:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836382.563788:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018822fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782757632:0@lo:103: 00000100:00100000:0.0:1788836382.563811:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836382.563883:0:3613:0:(import.c:65:import_set_state_nolock()) 000000007ec34459 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788836382.563894:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782756992:0@lo:38: 00010000:00010000:2.0:1788836382.563915:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836382.563932:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757504 00000100:00100000:2.0:1788836382.563936:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757504 00010000:00010000:2.0:1788836382.563952:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 15 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.563978:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757632 00000100:00100000:2.0:1788836382.563987:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757632 00010000:00010000:2.0:1788836382.563999:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 16 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836382.564041:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836382.564048:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070d340c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3616:x1875730782757504:12345-0@lo:103: 00010000:00010000:2.0:1788836382.564060:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836382.564064:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 16 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564074:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 16 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564098:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003fe84e28/0xf7b38383a6553c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553c37 expref: 16 pid: 6483 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564113:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836382.564143:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070d340c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3616:x1875730782757504:12345-0@lo:103: Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.564149:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836382.564160:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836382.564166:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6ab7dbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3615:x1875730782757632:12345-0@lo:103: 00010000:00010000:2.0:1788836382.564173:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836382.564176:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 14 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564184:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 14 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564195:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564208:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788836382.564223:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009471915s 00010000:00010000:2.0:1788836382.564227:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564233:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564239:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564245:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564251:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009be4d341 already unused, calling callback (000000009cfbf275) 00010000:00010000:2.0:1788836382.564254:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564261:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564268:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.564278:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836382.564304:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6ab7dbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3615:x1875730782757632:12345-0@lo:103: Request processed in 139us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.564310:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836382.564357:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fadab9e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782757504:0@lo:103: 00000100:00100000:2.0:1788836382.564387:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018822fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782757632:0@lo:103: 00010000:00010000:3.0:1788836382.564662:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7c7e691/0xf7b38383a6553b96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553b8f expref: 13 pid: 6485 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.564673:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003debc757 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782757376:0@lo:104: 00010000:00010000:3.0:1788836382.564691:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.564699:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.564703:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.564708:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009be4d341/0xf7b38383a6553c7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788836382.572604:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.572790:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788836382.572942:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.573158:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788836382.573368:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.573521:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788836382.578463:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.578860:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788836382.580706:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.581407:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788836382.581721:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788836382.582106:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788836382.584679:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788836382.584971:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788836382.585053:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875730782757760:0@lo:700: 00000100:00100000:0.0:1788836382.585132:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836382.585157:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc14015e going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.585221:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757760 00000100:00100000:2.0:1788836382.585230:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757760 00000100:00100000:2.0:1788836382.585287:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836382.585296:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a322a50b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1875730782757760:12345-0@lo:700: 00000040:01000000:1.0:1788836382.585436:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788836382.585896:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782757888:0@lo:1000: 00000100:00100000:1.0:1788836382.585949:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.585987:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c8ffab6 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.586051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782757888 00000100:00100000:2.0:1788836382.586060:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782757888 00000100:00100000:2.0:1788836382.586108:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836382.586115:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b108335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782757888:12345-0@lo:1000: 00000100:00100000:2.0:1788836382.586195:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b108335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782757888:12345-0@lo:1000: Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.586202:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836382.586246:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782757888:0@lo:1000: 00000040:01000000:2.0:1788836382.586277:0:7446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788836382.586299:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758016:0@lo:700: 00000100:00100000:2.0:1788836382.586327:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.586351:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000009dc19446 going to sleep for 11 seconds 00000040:01000000:0.0:1788836382.586834:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788836382.586945:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788836382.587404:0:7420:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788836382.587411:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788836382.587547:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836382.588534:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788836382.589096:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788836382.589130:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788836382.589303:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788836382.589503:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788836382.590075:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758016 00000100:00100000:2.0:1788836382.590096:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758016 00000100:00100000:2.0:1788836382.590151:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836382.590160:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052c9b626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758016:12345-0@lo:700: 00000100:00100000:2.0:1788836382.590263:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052c9b626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758016:12345-0@lo:700: Request processed in 104us (3935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.590271:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836382.590317:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758016:0@lo:700: 00000100:00100000:2.0:1788836382.590543:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1875730782758144:0@lo:900: 00000100:00100000:2.0:1788836382.590575:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.590604:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000009dc19446 going to sleep for 11 seconds 00000020:00080000:3.0:1788836382.592565:0:7444:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788836382.592575:0:7444:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788836382.592709:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758144 00000100:00100000:1.0:1788836382.592720:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758144 00000100:00100000:1.0:1788836382.592769:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836382.592778:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094d5d396 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1875730782758144:12345-0@lo:900: 00000100:00100000:1.0:1788836382.592877:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094d5d396 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1875730782758144:12345-0@lo:900: Request processed in 100us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836382.592885:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788836382.593266:0:7446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee8bfbbb x1875730782758144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836398 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836382.593280:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1875730782758144:0@lo:900: 00000100:00100000:2.0:1788836382.593406:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758272:0@lo:1000: 00000100:00100000:2.0:1788836382.593443:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.593470:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758272 00000100:00100000:2.0:1788836382.593474:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758272 00000100:00100000:2.0:1788836382.593503:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836382.593509:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eba5f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758272:12345-0@lo:1000: 00000100:00100000:2.0:1788836382.593569:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eba5f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758272:12345-0@lo:1000: Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.593575:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836382.593605:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0eef1e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.593618:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758272:0@lo:1000: 00000004:00080000:2.0:1788836382.593656:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009dc19446 with version 0 00000020:00100000:2.0:1788836382.593669:0:7446:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788836382.593674:0:7446:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ee8bfbbb x1875730782758528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836382.593682:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758528:0@lo:1000: 00000100:00100000:2.0:1788836382.593698:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.593711:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758528 00000100:00100000:2.0:1788836382.593713:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758528 00000100:00100000:2.0:1788836382.593730:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836382.593733:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cc33989 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758528:12345-0@lo:1000: 00000100:00100000:2.0:1788836382.594118:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cd0ca7 going to sleep for 11 seconds 40000000:02000000:2.0:1788836382.594411:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1788836382.598961:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788836382.599163:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788836382.599308:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788836382.599419:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788836382.599776:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788836382.599956:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788836382.600200:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788836382.600343:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788836382.601176:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788836382.601343:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788836382.601494:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788836382.601635:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788836382.601799:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788836382.601931:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788836382.602245:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788836382.602394:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:2.0:1788836382.609106:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1788836382.609208:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cc33989 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758528:12345-0@lo:1000: Request processed in 15470us (15505us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788836382.609223:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788836382.609273:0:7446:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788836382.609277:0:7446:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788836382.609294:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758528:0@lo:1000: 00000100:00100000:2.0:1788836382.609394:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758656:0@lo:1000: 00000100:00100000:2.0:1788836382.609434:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.609466:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758656 00000100:00100000:2.0:1788836382.609473:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758656 00000100:00100000:3.0:1788836382.609618:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a322a50b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1875730782757760:12345-0@lo:700: Request processed in 24322us (24485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836382.609632:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788836382.609722:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b978ecf x1875730782757760/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788836398 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836382.609746:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875730782757760:0@lo:700: 40000000:02000000:1.0:1788836382.609756:0:7445:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1788836382.610069:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0eef1e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.610133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836382.610144:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43f9b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758656:12345-0@lo:1000: 00000100:00100000:2.0:1788836382.610270:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43f9b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1875730782758656:12345-0@lo:1000: Request processed in 129us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.610277:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:0.0:1788836382.612697:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788836382.612854:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:3.0:1788836382.613352:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8bfbbb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1875730782758656:0@lo:1000: 00100000:10000000:0.0:1788836382.613404:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:3.0:1788836382.613419:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788836382.613470:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002998c364 with version 1 00100000:10000000:0.0:1788836382.614004:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788836382.614158:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788836382.614375:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788836382.614686:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788836382.614815:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788836382.614949:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788836382.615095:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788836382.615213:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:3.0:1788836382.615595:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788836382.615670:0:7446:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788836382.615901:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788836382.616070:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788836382.616257:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788836382.616954:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000004:00080000:2.0:1788836382.617350:0:7436:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004f715c9d version 1 rpc_version 1 00000020:00100000:2.0:1788836382.617387:0:7436:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00100000:10000000:0.0:1788836382.617388:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000100:00100000:2.0:1788836382.617398:0:7436:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c3789375 x1875730782758912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836382.617419:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7436:1875730782758912:0@lo:1000: 00000100:00100000:2.0:1788836382.617488:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836382.617549:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa4d9195 going to sleep for 11 seconds 00000100:00100000:1.0:1788836382.617735:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782758912 00000100:00100000:1.0:1788836382.617743:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782758912 00000100:00100000:1.0:1788836382.617795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836382.617803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7e6555 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7436:x1875730782758912:12345-0@lo:1000: 00000001:00000004:1.0:1788836382.618254:0:7420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788836382.623120:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788836382.623377:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7e6555 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7436:x1875730782758912:12345-0@lo:1000: Request processed in 5571us (5885us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788836382.623391:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788836382.623482:0:7436:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788836382.623488:0:7436:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788836382.623561:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7436:1875730782758912:0@lo:1000: 00000001:00080000:1.0:1788836382.641500:0:7420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788836382.641617:0:7420:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2ab019af988 00100000:10000000:1.0:1788836382.641625:0:7420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788836382.642259:0:7420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836382.642292:0:7420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836382.642430:0:7420:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788836382.642454:0:7420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788836382.646148:0:7420:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836382.648415:0:7420:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788836382.649966:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836382.672783:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788836382.672873:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788836382.672878:0:7445:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788836383.102120:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836384.130756:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836385.150691:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836386.174260:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836387.199134:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836387.582514:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072c5a8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782759424:0@lo:400: 00000100:00100000:3.0:1788836387.582593:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836387.582645:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836387.582651:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003debc757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782759040:0@lo:400: 00000100:00100000:2.0:1788836387.582760:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782759552:0@lo:41: 00000100:00100000:2.0:1788836387.582794:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836387.582826:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759552 00000100:00100000:2.0:1788836387.582833:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759552 00000100:00100000:2.0:1788836387.582875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836387.582882:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c76b976 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782759552:12345-0@lo:41: 00000004:00000024:2.0:1788836387.582917:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788836387.582955:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c76b976 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782759552:12345-0@lo:41: Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836387.582962:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836387.583062:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782759552:0@lo:41: 00000100:00100000:3.0:1788836387.583182:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836387.583211:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782759168:0@lo:400: 00000100:00100000:3.0:1788836387.583236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836387.583253:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836387.583258:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280ff558 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782759296:0@lo:400: 00000100:00100000:3.0:1788836387.583277:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836387.583300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759424 00000100:00100000:3.0:1788836387.583304:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759424 00000100:00100000:3.0:1788836387.583329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759168 00000100:00100000:3.0:1788836387.583332:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759168 00000100:00100000:3.0:1788836387.583345:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836387.583350:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f9dba33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782759424:12345-0@lo:400: 00000100:00100000:3.0:1788836387.583387:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f9dba33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782759424:12345-0@lo:400: Request processed in 37us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836387.583393:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836387.583406:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836387.583412:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f41a041 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782759168:12345-0@lo:400: 00000100:00100000:3.0:1788836387.583443:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f41a041 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782759168:12345-0@lo:400: Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836387.583460:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788836387.583494:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a541e913 x1875730782759168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836387.583503:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782759168:0@lo:400: 00010000:00080000:3.0:1788836387.583524:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000072c5a8c5 x1875730782759424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836387.583532:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072c5a8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782759424:0@lo:400: 00000100:00100000:2.0:1788836387.583618:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759040 00000100:00100000:2.0:1788836387.583623:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759040 00000100:00100000:2.0:1788836387.583667:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836387.583674:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d68fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3614:x1875730782759040:12345-0@lo:400: 00000100:00100000:2.0:1788836387.583710:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d68fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3614:x1875730782759040:12345-0@lo:400: Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836387.583716:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836387.583738:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759296 00000100:00100000:2.0:1788836387.583748:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759296 00000100:00100000:2.0:1788836387.583769:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836387.583774:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b92c241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782759296:12345-0@lo:400: 00000100:00100000:2.0:1788836387.583806:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b92c241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782759296:12345-0@lo:400: Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836387.583810:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836387.583834:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280ff558 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782759296:0@lo:400: 00000100:00100000:2.0:1788836387.583853:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003debc757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782759040:0@lo:400: 00000001:02000400:0.0:1788836387.899215:0:7691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788836388.233111:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836389.246996:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788836389.264424:0:7743:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836389.265249:0:7743:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836390.270315:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788836390.654287:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836390.654301:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf444f2000 from 4 10000000:01000000:0.0:1788836390.654308:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836390.654452:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.654470:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.654485:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.654524:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759680:0@lo:101: 00000100:00100000:0.0:1788836390.655188:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.655358:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000008587731e going to sleep for 11 seconds 00000100:00100000:1.0:1788836390.670158:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759680 00000100:00100000:1.0:1788836390.670182:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759680 00000100:00100000:1.0:1788836390.670378:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788836390.670391:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd090fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:6487:x1875730782759680:12345-0@lo:101: 00010000:00010000:1.0:1788836390.670418:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836390.670466:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca957239/0xf7b38383a6553c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553c84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836390.670504:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca957239/0xf7b38383a6553c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836390.670518:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca957239/0xf7b38383a6553c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836390.670530:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca957239, rc 0) 00000100:00100000:1.0:1788836390.670655:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd090fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:6487:x1875730782759680:12345-0@lo:101: Request processed in 267us (15474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836390.670663:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836390.670793:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759680:0@lo:101: 00010000:00010000:0.0:1788836390.670830:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.670847:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.677312:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759808:0@lo:256: 00000100:00100000:0.0:1788836390.677443:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.683814:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000008587731e going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.687908:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759808 00000100:00100000:2.0:1788836390.687935:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759808 00000100:00100000:2.0:1788836390.688536:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836390.688547:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e93e5296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:6487:x1875730782759808:12345-0@lo:256: 20000000:01000000:2.0:1788836390.688586:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836390.688631:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836390.688635:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788836390.688825:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e93e5296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:6487:x1875730782759808:12345-0@lo:256: Request processed in 279us (11382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.689058:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759808:0@lo:256: 10000000:01000000:0.0:1788836390.689130:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836390.689142:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.689152:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000b6506923/0xf7b38383a6553c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836390.689164:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788836390.689167:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf50b59800 from 21 10000000:01000000:0.0:1788836390.689170:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836390.689213:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.689222:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.689231:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.689251:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759936:0@lo:101: 00000100:00100000:0.0:1788836390.689296:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.689329:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000008587731e going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.689545:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836390.689587:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782759936 00000100:00100000:2.0:1788836390.689664:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782759936 00000100:00100000:2.0:1788836390.689698:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836390.689704:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000978b959c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:6487:x1875730782759936:12345-0@lo:101: 00010000:00010000:2.0:1788836390.689717:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836390.689731:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c65f6d56/0xf7b38383a6553c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553c92 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.689770:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c65f6d56/0xf7b38383a6553c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.689781:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c65f6d56/0xf7b38383a6553c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.689790:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c65f6d56, rc 0) 00000100:00100000:2.0:1788836390.690706:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000978b959c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782759936:12345-0@lo:101: Request processed in 996us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.690717:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836390.690870:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782759936:0@lo:101: 00010000:00010000:0.0:1788836390.690906:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.690920:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.691209:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760064:0@lo:501: 00000100:00100000:0.0:1788836390.691260:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.691305:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000008587731e going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.691338:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760064 00000100:00100000:0.0:1788836390.691343:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760064 00000100:00100000:0.0:1788836390.691444:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836390.691453:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e669b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782760064:12345-0@lo:501: 00000100:00100000:0.0:1788836390.692536:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e669b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782760064:12345-0@lo:501: Request processed in 1080us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.692549:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836390.693188:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760064:0@lo:501: 00000100:00100000:0.0:1788836390.693292:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760192:0@lo:503: 00000100:00100000:0.0:1788836390.693359:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.693810:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000008587731e going to sleep for 11 seconds 00000100:00100000:3.0:1788836390.694287:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760192 00000100:00100000:3.0:1788836390.694299:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760192 00000100:00100000:3.0:1788836390.694380:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836390.694391:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000835198be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782760192:12345-0@lo:503: 00000100:00100000:3.0:1788836390.694571:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000835198be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782760192:12345-0@lo:503: Request processed in 181us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.694580:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836390.696847:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760192:0@lo:503: 00000100:00100000:2.0:1788836390.699540:0:7795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7795:1875730782760320:0@lo:502: 00000100:00100000:2.0:1788836390.699694:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.699766:0:7795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000937b0a22 going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.700473:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760320 00000100:00100000:0.0:1788836390.700486:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760320 00000100:00100000:0.0:1788836390.700559:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836390.700570:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000465248fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7795:x1875730782760320:12345-0@lo:502: 00000100:00100000:0.0:1788836390.700806:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000465248fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7795:x1875730782760320:12345-0@lo:502: Request processed in 238us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.701332:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836390.702221:0:7795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7795:1875730782760320:0@lo:502: 00000100:00100000:2.0:1788836390.702328:0:7795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7795:1875730782760448:0@lo:502: 00000100:00100000:2.0:1788836390.702422:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.702476:0:7795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000937b0a22 going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.702629:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760448 00000100:00100000:0.0:1788836390.702637:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760448 00000100:00100000:0.0:1788836390.702703:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836390.702713:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d61af65e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7795:x1875730782760448:12345-0@lo:502: 00000100:00100000:0.0:1788836390.703499:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d61af65e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:7795:x1875730782760448:12345-0@lo:502: Request processed in 782us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.703511:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836390.708162:0:7795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3789375 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7795:1875730782760448:0@lo:502: 00000040:00080000:3.0:1788836390.708244:0:7795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788836390.709527:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788836390.709564:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836390.709576:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.709591:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000adfd6694/0xf7b38383a6553c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836390.709709:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836390.709712:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf50b59800 from 4 10000000:01000000:0.0:1788836390.709716:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836390.709769:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.709777:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.709787:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.709813:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760576:0@lo:101: 00000100:00100000:0.0:1788836390.710266:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.710446:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f61b26 going to sleep for 11 seconds 00000100:00100000:3.0:1788836390.710562:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760576 00000100:00100000:3.0:1788836390.710574:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760576 00000100:00100000:3.0:1788836390.710722:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836390.710732:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ca445c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782760576:12345-0@lo:101: 00010000:00010000:3.0:1788836390.710751:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836390.710769:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009be4d341/0xf7b38383a6553ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ca0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836390.710799:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009be4d341/0xf7b38383a6553ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836390.711256:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009be4d341/0xf7b38383a6553ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836390.711270:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009be4d341, rc 0) 00000100:00100000:3.0:1788836390.711477:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ca445c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782760576:12345-0@lo:101: Request processed in 745us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.711485:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788836390.711602:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760576:0@lo:101: 00010000:00010000:0.0:1788836390.711625:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.711637:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.711717:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760704:0@lo:256: 00000100:00100000:0.0:1788836390.711760:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.712289:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f61b26 going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.712515:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760704 00000100:00100000:2.0:1788836390.712525:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760704 00000100:00100000:2.0:1788836390.712576:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836390.712585:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023e677a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782760704:12345-0@lo:256: 20000000:01000000:2.0:1788836390.712623:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836390.712649:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836390.712653:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788836390.712774:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023e677a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782760704:12345-0@lo:256: Request processed in 190us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.712791:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788836390.713229:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760704:0@lo:256: 10000000:01000000:0.0:1788836390.713300:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836390.713311:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.713323:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000e9152b13/0xf7b38383a6553ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836390.713335:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788836390.713338:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788836390.713341:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788836390.713495:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.713506:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.713528:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.713549:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760832:0@lo:101: 00000100:00100000:0.0:1788836390.713592:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.714741:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f61b26 going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.715119:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760832 00000100:00100000:2.0:1788836390.715131:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760832 00000100:00100000:2.0:1788836390.715187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836390.715196:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1ebea91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782760832:12345-0@lo:101: 00010000:00010000:2.0:1788836390.715215:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836390.715233:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000137f1253/0xf7b38383a6553cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553cae expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.715266:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000137f1253/0xf7b38383a6553cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553cae expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.715352:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000137f1253/0xf7b38383a6553cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cae expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.715426:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000137f1253, rc 0) 00000100:00100000:2.0:1788836390.715509:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1ebea91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782760832:12345-0@lo:101: Request processed in 314us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.715517:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788836390.715707:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760832:0@lo:101: 00010000:00010000:0.0:1788836390.715726:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.715736:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.716213:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760960:0@lo:501: 00000100:00100000:0.0:1788836390.716266:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.716483:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f61b26 going to sleep for 11 seconds 00000100:00100000:3.0:1788836390.716623:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782760960 00000100:00100000:3.0:1788836390.716632:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782760960 00000100:00100000:2.0:1788836390.717213:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836390.717229:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001199ec24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782760960:12345-0@lo:501: 00000100:00100000:2.0:1788836390.717702:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001199ec24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782760960:12345-0@lo:501: Request processed in 477us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.717712:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788836390.718230:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782760960:0@lo:501: 00000100:00100000:0.0:1788836390.718439:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782761088:0@lo:503: 00000100:00100000:0.0:1788836390.718510:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.718589:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f61b26 going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.718707:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761088 00000100:00100000:2.0:1788836390.718715:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761088 00000100:00100000:2.0:1788836390.718798:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836390.718809:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d132f75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782761088:12345-0@lo:503: 00000100:00100000:2.0:1788836390.718968:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d132f75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782761088:12345-0@lo:503: Request processed in 161us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.718976:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836390.719073:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782761088:0@lo:503: 00000100:00100000:0.0:1788836390.720410:0:7796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7796:1875730782761216:0@lo:502: 00000100:00100000:0.0:1788836390.720497:0:7796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.721053:0:7796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7e1cde4 going to sleep for 11 seconds 00000100:00100000:3.0:1788836390.721217:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761216 00000100:00100000:3.0:1788836390.721231:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761216 00000100:00100000:3.0:1788836390.721454:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836390.721466:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d46276b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:7796:x1875730782761216:12345-0@lo:502: 00000100:00100000:3.0:1788836390.721735:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d46276b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:7796:x1875730782761216:12345-0@lo:502: Request processed in 270us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.721745:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836390.722110:0:7796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7796:1875730782761216:0@lo:502: 00000020:01000000:0.0:1788836390.722159:0:7796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836390.722172:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836390.722175:0:7796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788836390.722180:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836390.722184:0:7796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:00000080:0.0:1788836390.722213:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836390.722231:0:7796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b6726fbd) 00000020:00000080:0.0:1788836390.722259:0:7796:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788836390.722265:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836390.722547:0:7796:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788836390.722554:0:7796:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788836390.722562:0:7796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553cc3 00010000:00080000:0.0:1788836390.722676:0:7796:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b254307e@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836390.735768:0:7796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788836390.747108:0:7796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836390.747141:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788836390.747212:0:7796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836390.747248:0:7796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553cca 00000100:00080000:0.0:1788836390.747263:0:7796:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836390.747269:0:7796:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000b254307e using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836390.747463:0:7796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f5e71428 x1875730782761344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836390.747500:0:7796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788836390.747566:0:7796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788836390.747753:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782761344:0@lo:38: 00000100:00100000:2.0:1788836390.747873:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.747970:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761344 00000100:00100000:2.0:1788836390.747979:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761344 00000100:00100000:2.0:1788836390.748182:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836390.748191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3789375 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782761344:12345-0@lo:38: 00010000:00080000:2.0:1788836390.748228:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788836390.748288:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553cd1 00000004:00100000:2.0:1788836390.748311:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788836390.748319:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788836390.749516:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5c5b36c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782761472:0@lo:400: 00000100:00100000:2.0:1788836390.749590:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.749671:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049176149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782761600:0@lo:400: 00000100:00100000:1.0:1788836390.749711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.749993:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bd896ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782761728:0@lo:400: 00000020:01000000:0.0:1788836390.750901:0:7796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836390.750910:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836390.750913:0:7796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788836390.750917:0:7796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836390.750921:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836390.750922:0:7796:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836390.750950:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836390.750953:0:7796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788836390.750998:0:7796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7796:1875730782761856:0@lo:502: 00000100:00080000:1.0:1788836390.751246:0:7799:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000e5d0fcde x1875730782761984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836390.751260:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 000000000976fcda going to sleep for 0 seconds 00000100:00100000:2.0:1788836390.751547:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788836390.751557:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788836390.751574:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761472 00000100:00100000:2.0:1788836390.751582:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761472 00000100:00100000:1.0:1788836390.751685:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.751729:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761728 00000100:00100000:1.0:1788836390.751733:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761728 00000100:00100000:1.0:1788836390.751790:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836390.751798:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000115aee7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782761728:12345-0@lo:400: 00000100:00100000:1.0:1788836390.751876:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000115aee7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782761728:12345-0@lo:400: Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836390.751886:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788836390.751949:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000bd896ec x1875730782761728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836390.751974:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bd896ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782761728:0@lo:400: 00000100:00100000:2.0:1788836390.752482:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836390.752492:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8bfbbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782761472:12345-0@lo:400: 00000100:00100000:2.0:1788836390.752543:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8bfbbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782761472:12345-0@lo:400: Request processed in 53us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.752550:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788836390.752582:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f5c5b36c x1875730782761472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836390.752792:0:7796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.752869:0:7796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47f990f going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.752926:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5c5b36c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782761472:0@lo:400: 00000100:00100000:2.0:1788836390.755835:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761600 00000100:00100000:2.0:1788836390.755856:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761600 00000100:00100000:2.0:1788836390.756568:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836390.756583:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013279471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782761600:12345-0@lo:400: 00000100:00100000:3.0:1788836390.756899:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761856 00000100:00100000:3.0:1788836390.756908:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761856 00000100:00100000:3.0:1788836390.756961:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836390.756969:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054506e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:7796:x1875730782761856:12345-0@lo:502: 00000100:00100000:3.0:1788836390.757155:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054506e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:7796:x1875730782761856:12345-0@lo:502: Request processed in 187us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.757164:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836390.757560:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013279471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782761600:12345-0@lo:400: Request processed in 981us (7847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.757569:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836390.757744:0:7796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:7796:1875730782761856:0@lo:502: 00000020:01000000:0.0:1788836390.757789:0:7796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836390.757799:0:7796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836390.757802:0:7796:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788836390.757808:0:7796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788836390.758171:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788836390.758193:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788836390.758205:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.758216:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 0000000037c4c5df/0xf7b38383a6553cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836390.758228:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788836390.758231:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adf48a1cd28 from 1 10000000:01000000:2.0:1788836390.758234:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788836390.758271:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.758289:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836390.758299:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836390.758334:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb3a9aa1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782762112:0@lo:101: 00000100:00100000:2.0:1788836390.758442:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.758475:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b6b5e96 going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.761275:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762112 00000100:00100000:0.0:1788836390.761296:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762112 00000100:00100000:0.0:1788836390.761377:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836390.761388:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e92d46bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782762112:12345-0@lo:101: 00010000:00010000:0.0:1788836390.761412:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836390.761432:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a416d72/0xf7b38383a6553cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553cd8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.761469:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a416d72/0xf7b38383a6553cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.761480:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a416d72/0xf7b38383a6553cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.761490:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a416d72, rc 0) 00000100:00100000:0.0:1788836390.761580:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e92d46bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782762112:12345-0@lo:101: Request processed in 194us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.761587:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836390.761668:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb3a9aa1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782762112:0@lo:101: 00010000:00010000:0.0:1788836390.761702:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.761713:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836390.761831:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782762240:0@lo:501: 00000100:00100000:0.0:1788836390.761874:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836390.761912:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbedd156 going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.761930:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762240 00000100:00100000:0.0:1788836390.761935:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762240 00000100:00100000:0.0:1788836390.761974:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788836390.761979:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd191b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782762240:12345-0@lo:501: 00000100:00100000:0.0:1788836390.763329:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd191b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782762240:12345-0@lo:501: Request processed in 1344us (1449us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836390.763343:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788836390.763403:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b978ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782762240:0@lo:501: 10000000:01000000:0.0:1788836390.763444:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788836390.763454:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836390.763465:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000531058cf/0xf7b38383a6553cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836390.767916:0:6496:0:(import.c:65:import_set_state_nolock()) 0000000040186a13 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836390.768267:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3789375 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782761344:12345-0@lo:38: Request processed in 20072us (20391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.768360:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836390.768899:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049176149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782761600:0@lo:400: 00000100:00100000:2.0:1788836390.769098:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836390.769111:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788836390.769122:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788836390.769129:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788836390.769133:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000b254307e lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788836390.769155:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000976fcda): req@00000000e5d0fcde x1875730782761984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836390.769172:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5e71428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782761344:0@lo:38: 00000100:00100000:1.0:1788836390.769375:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.769423:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 000000000976fcda going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.769579:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782761984 00000100:00100000:2.0:1788836390.769588:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782761984 00000100:00100000:2.0:1788836390.769720:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836390.769731:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049176149 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782761984:12345-0@lo:1000: 00000100:00100000:2.0:1788836390.769844:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049176149 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782761984:12345-0@lo:1000: Request processed in 115us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.769852:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836390.770133:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836390.770151:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072c5a8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782762368:0@lo:41: 00000100:00100000:0.0:1788836390.770194:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.770394:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782761984:0@lo:1000: 00000040:01000000:1.0:1788836390.770438:0:7799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788836390.770479:0:7799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762496:0@lo:1000: 00000100:00100000:1.0:1788836390.770513:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.770543:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 000000000976fcda going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.770682:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762368 00000100:00100000:0.0:1788836390.770688:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762368 00000100:00100000:0.0:1788836390.770718:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762496 00000100:00100000:0.0:1788836390.770721:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762496 00000100:00100000:0.0:1788836390.770735:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836390.770742:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b978ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782762368:12345-0@lo:41: 00000004:00000024:0.0:1788836390.770772:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788836390.770818:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b978ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782762368:12345-0@lo:41: Request processed in 76us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.770825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836390.770840:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836390.770846:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bd896ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762496:12345-0@lo:1000: 00000100:00100000:0.0:1788836390.770980:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bd896ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762496:12345-0@lo:1000: Request processed in 134us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.770987:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836390.771264:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072c5a8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782762368:0@lo:41: 00000100:00100000:1.0:1788836390.771490:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762496:0@lo:1000: 00000100:00100000:1.0:1788836390.771541:0:7799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762624:0@lo:700: 00000100:00100000:1.0:1788836390.771575:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.771673:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040979536 going to sleep for 11 seconds 00000100:00100000:3.0:1788836390.771743:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762624 00000100:00100000:3.0:1788836390.771749:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762624 00000100:00100000:3.0:1788836390.771792:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836390.771799:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e924b7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762624:12345-0@lo:700: 00000100:00100000:3.0:1788836390.771875:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e924b7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762624:12345-0@lo:700: Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836390.771883:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836390.772125:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762624:0@lo:700: 00000100:00100000:1.0:1788836390.772754:0:7799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762752:0@lo:1000: 00000100:00100000:1.0:1788836390.772803:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.772988:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 000000003af2ed9e going to sleep for 11 seconds 00000100:00100000:2.0:1788836390.776775:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782762752 00000100:00100000:2.0:1788836390.776798:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782762752 00000100:00100000:2.0:1788836390.776995:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836390.777008:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000557c905b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762752:12345-0@lo:1000: 00000100:00100000:2.0:1788836390.777432:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000557c905b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782762752:12345-0@lo:1000: Request processed in 427us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836390.777442:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836390.783231:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782762752:0@lo:1000: 00000004:00080000:2.0:1788836390.789245:0:7799:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000040979536 with version 0 00000020:00100000:2.0:1788836390.789311:0:7799:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788836390.789324:0:7799:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007205c6b9 x1875730782763008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836390.789354:0:7799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782763008:0@lo:1000: 00000100:00100000:2.0:1788836390.789450:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.789508:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 000000009bb3fbd1 going to sleep for 11 seconds 00000100:00100000:1.0:1788836390.790134:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763008 00000100:00100000:1.0:1788836390.790146:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763008 00000100:00100000:1.0:1788836390.790226:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836390.790238:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f4cbc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7799:x1875730782763008:12345-0@lo:1000: 00000001:00080000:2.0:1788836390.795182:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788836390.795205:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788836390.795755:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f4cbc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7799:x1875730782763008:12345-0@lo:1000: Request processed in 5512us (6298us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788836390.795789:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788836390.796161:0:7799:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788836390.796168:0:7799:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788836390.796187:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782763008:0@lo:1000: 00000100:00100000:2.0:1788836390.797678:0:7799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782763136:0@lo:1000: 00000100:00100000:2.0:1788836390.797774:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836390.797839:0:7799:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2e43abc going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.798189:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763136 00000100:00100000:0.0:1788836390.798202:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763136 00000100:00100000:0.0:1788836390.798289:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836390.798299:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f83237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7799:x1875730782763136:12345-0@lo:1000: 00000100:00100000:0.0:1788836390.798431:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f83237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7799:x1875730782763136:12345-0@lo:1000: Request processed in 133us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836390.798439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836390.798643:0:7799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7799:1875730782763136:0@lo:1000: 00000040:00080000:2.0:1788836390.798677:0:7799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788836390.798735:0:7799:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009bb3fbd1 with version 1 00000004:00080000:1.0:1788836390.800400:0:7797:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000a958fdc version 1 rpc_version 1 00000020:00100000:1.0:1788836390.800455:0:7797:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788836390.800466:0:7797:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e5d0fcde x1875730782763392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836390.800492:0:7797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7797:1875730782763392:0@lo:1000: 00000100:00100000:1.0:1788836390.800568:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836390.800921:0:7797:0:(client.c:2715:ptlrpc_set_wait()) set 000000003af2ed9e going to sleep for 11 seconds 00000100:00100000:0.0:1788836390.801033:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763392 00000100:00100000:0.0:1788836390.801054:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763392 00000100:00100000:0.0:1788836390.801129:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836390.801140:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5c5b36c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7797:x1875730782763392:12345-0@lo:1000: 00000040:00080000:2.0:1788836390.807843:0:7799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788836390.808464:0:7799:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788836390.808472:0:7799:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788836390.810711:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788836390.812246:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5c5b36c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7797:x1875730782763392:12345-0@lo:1000: Request processed in 11098us (11668us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788836390.812265:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788836390.812480:0:7797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788836390.812486:0:7797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788836390.812507:0:7797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5d0fcde pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7797:1875730782763392:0@lo:1000: 00010000:00010000:0.0:1788836391.294222:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836392.319177:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836392.702223:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836392.702259:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782763520:0@lo:41: 00000100:00100000:2.0:1788836392.703138:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836392.703193:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763520 00000100:00100000:0.0:1788836392.703205:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763520 00000100:00100000:0.0:1788836392.703282:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836392.703293:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ed994b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782763520:12345-0@lo:41: 00000004:00000024:0.0:1788836392.703344:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788836392.703415:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ed994b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782763520:12345-0@lo:41: Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.703423:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836392.703705:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007205c6b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782763520:0@lo:41: 00000020:00000004:0.0:1788836392.761720:0:7850:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836392.763366:0:7850:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788836393.342121:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836393.679404:0:7898:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff17270e70 20000000:00000080:1.0:1788836393.679601:0:7898:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adf7a422c00 uarg=0000000000000000 20000000:01000000:1.0:1788836393.679666:0:7898:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788836393.679675:0:7898:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788836393.679682:0:7898:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788836393.679785:0:7898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788836393.679801:0:7898:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788836393.695139:0:7898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836393.695409:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788836393.695441:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788836393.695458:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788836393.695479:0:7898:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788836393.695501:0:7898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.695518:0:7898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.695536:0:7898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.695542:0:7898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.695581:0:7898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.695594:0:7898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 17 pid: 6483 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836393.695608:0:7898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875730782763648:0@lo:104: 00000100:00100000:1.0:1788836393.695678:0:7898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836393.697597:0:7898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836393.697614:0:7898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 17 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836393.697629:0:7898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875730782763776:0@lo:104: 00000100:00100000:1.0:1788836393.697665:0:7898:0:(client.c:2715:ptlrpc_set_wait()) set 000000003af2ed9e going to sleep for 11 seconds 00000100:00100000:2.0:1788836393.701858:0:7432:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788836393.701930:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836393.701968:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763648 00000100:00100000:2.0:1788836393.701977:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763648 00000100:00100000:2.0:1788836393.702114:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763776 00000100:00100000:2.0:1788836393.702118:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763776 00000100:00100000:3.0:1788836393.702328:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836393.702338:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000652bef4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:7898:x1875730782763648:12345-0@lo:104: 00010000:00010000:3.0:1788836393.702357:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836393.702438:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836393.702443:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000652bef4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:7898:x1875730782763648:12345-0@lo:104: Request processed in 108us (6766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836393.702451:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836393.702503:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836393.702509:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007205c6b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:7898:x1875730782763776:12345-0@lo:104: 00010000:00010000:3.0:1788836393.702517:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836393.702546:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836393.702550:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007205c6b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:7898:x1875730782763776:12345-0@lo:104: Request processed in 42us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836393.702565:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788836393.702625:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836393.702631:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702639:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cc07f2f already unused, calling callback (000000009c9de97f) 10000000:00010000:0.0:1788836393.702643:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702652:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836393.702658:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836393.702665:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836393.702705:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702721:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836393.702741:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702747:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000001cc07f2f/0xf7b38383a6553c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c53 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702763:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836393.702765:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702771:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001bca264e already unused, calling callback (000000009c9de97f) 10000000:00010000:0.0:1788836393.702773:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702778:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836393.702794:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836393.702799:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836393.702813:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702818:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836393.702832:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702837:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000001bca264e/0xf7b38383a6553b5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553b65 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.702856:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836393.702857:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836393.702858:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836393.702865:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836393.702871:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836393.702885:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018822fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782763904:0@lo:103: 00000100:00100000:0.0:1788836393.702934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836393.702970:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fadab9e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782764032:0@lo:103: 00000100:00100000:0.0:1788836393.702991:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836393.703043:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782763904 00000100:00100000:0.0:1788836393.703047:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782763904 00010000:00010000:0.0:1788836393.703066:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 18 pid: 6483 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836393.703086:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764032 00000100:00100000:0.0:1788836393.703089:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764032 00010000:00010000:0.0:1788836393.703100:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 19 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836393.703111:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836393.703117:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b01e6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3616:x1875730782763904:12345-0@lo:103: 00010000:00010000:0.0:1788836393.703127:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836393.703131:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 19 pid: 6483 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703141:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 19 pid: 6483 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703167:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836393.703196:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b01e6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3616:x1875730782763904:12345-0@lo:103: Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836393.703203:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836393.703216:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836393.703222:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070d340c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3614:x1875730782764032:12345-0@lo:103: 00010000:00010000:0.0:1788836393.703230:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836393.703233:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 18 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703241:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 18 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703251:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703258:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703272:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703278:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703284:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703290:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703301:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000042154d73 already unused, calling callback (000000009cfbf275) 00010000:00010000:0.0:1788836393.703304:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703310:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703318:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703327:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836393.703352:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070d340c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3614:x1875730782764032:12345-0@lo:103: Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836393.703358:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836393.703396:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fadab9e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782764032:0@lo:103: 00000100:00100000:0.0:1788836393.703419:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018822fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782763904:0@lo:103: 00010000:00010000:0.0:1788836393.703447:0:7898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a696508a/0xf7b38383a6553c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553c4c expref: 17 pid: 6483 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836393.703458:0:7898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875730782763648:0@lo:104: 00010000:00010000:0.0:1788836393.703467:0:7898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065efdabe/0xf7b38383a6553b65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553b5e expref: 16 pid: 6484 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836393.703490:0:7898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875730782763776:0@lo:104: 00010000:00010000:0.0:1788836393.703505:0:7898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703523:0:7898:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703528:0:7898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836393.703533:0:7898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000042154d73/0xf7b38383a6553ce6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836394.367212:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836395.390223:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836395.795467:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac3af2b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782764544:0@lo:400: 00000100:00100000:0.0:1788836395.795583:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836395.795714:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782764160:0@lo:400: 00000100:00100000:3.0:1788836395.795760:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836395.796601:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782764288:0@lo:400: 00000100:00100000:0.0:1788836395.796646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836395.796686:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f3c1f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782764800:0@lo:41: 00000100:00100000:0.0:1788836395.796713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836395.796735:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836395.796740:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782764416:0@lo:400: 00000100:00100000:0.0:1788836395.796764:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836395.796816:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764544 00000100:00100000:0.0:1788836395.796827:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764544 00000100:00100000:1.0:1788836395.796938:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764288 00000100:00100000:1.0:1788836395.796943:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764288 00000100:00100000:1.0:1788836395.797002:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836395.797035:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fadab9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782764288:12345-0@lo:400: 00000100:00100000:1.0:1788836395.797106:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fadab9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782764288:12345-0@lo:400: Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836395.797133:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836395.797169:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764800 00000100:00100000:1.0:1788836395.797172:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764800 00000100:00100000:1.0:1788836395.797198:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764416 00000100:00100000:1.0:1788836395.797200:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764416 00000100:00100000:1.0:1788836395.797213:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788836395.797218:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e2b0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782764800:12345-0@lo:41: 00000004:00000024:1.0:1788836395.797257:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788836395.797305:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e2b0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782764800:12345-0@lo:41: Request processed in 86us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836395.797311:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788836395.797325:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836395.797330:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc2bcb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782764416:12345-0@lo:400: 00000100:00100000:1.0:1788836395.797357:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc2bcb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782764416:12345-0@lo:400: Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836395.797363:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836395.797411:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2698323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782764416:0@lo:400: 00010000:00080000:1.0:1788836395.797425:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000181cacde x1875730782764288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836395.797436:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000181cacde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782764288:0@lo:400: 00000100:00100000:1.0:1788836395.797450:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f3c1f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782764800:0@lo:41: 00000100:00100000:0.0:1788836395.797778:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836395.797786:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018822fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782764544:12345-0@lo:400: 00000100:00100000:0.0:1788836395.797830:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018822fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782764544:12345-0@lo:400: Request processed in 46us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836395.797836:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788836395.797991:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ac3af2b9 x1875730782764544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836395.798003:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac3af2b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782764544:0@lo:400: 00000100:00100000:3.0:1788836395.798129:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5166406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782764672:0@lo:400: 00000100:00100000:3.0:1788836395.798169:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836395.798234:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764160 00000100:00100000:3.0:1788836395.798239:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764160 00000100:00100000:3.0:1788836395.798286:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836395.798293:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c3f89c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3615:x1875730782764160:12345-0@lo:400: 00000100:00100000:3.0:1788836395.798333:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c3f89c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3615:x1875730782764160:12345-0@lo:400: Request processed in 41us (2573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836395.798339:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836395.798370:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764672 00000100:00100000:3.0:1788836395.798373:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764672 00000100:00100000:3.0:1788836395.798395:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836395.798400:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b08be9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782764672:12345-0@lo:400: 00000100:00100000:3.0:1788836395.798431:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b08be9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782764672:12345-0@lo:400: Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836395.798437:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836395.798457:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004787c37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782764160:0@lo:400: 00000100:00100000:3.0:1788836395.798466:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5166406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782764672:0@lo:400: 00010000:00010000:2.0:1788836396.416044:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836397.311714:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836397.311725:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf444f2000 from 1 10000000:01000000:3.0:1788836397.311731:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836397.311799:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000fcd9c0e8/0xf7b38383a6553ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.311867:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000fcd9c0e8/0xf7b38383a6553ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.311881:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000fcd9c0e8/0xf7b38383a6553ced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836397.311911:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f50f8aca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782764928:0@lo:101: 00000100:00100000:3.0:1788836397.312005:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836397.312074:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782764928 00000100:00100000:2.0:1788836397.312084:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782764928 00000100:00100000:3.0:1788836397.312111:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000342d8747 going to sleep for 11 seconds 00000100:00100000:2.0:1788836397.312140:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836397.312223:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bedf677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782764928:12345-0@lo:101: 00010000:00010000:2.0:1788836397.312241:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836397.312258:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b824afad/0xf7b38383a6553cf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ced expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836397.312288:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b824afad/0xf7b38383a6553cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ced expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836397.312298:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b824afad/0xf7b38383a6553cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ced expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836397.312308:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b824afad, rc 0) 00000100:00100000:2.0:1788836397.312363:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bedf677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782764928:12345-0@lo:101: Request processed in 214us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.312423:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f50f8aca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782764928:0@lo:101: 00010000:00010000:0.0:1788836397.312441:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000fcd9c0e8/0xf7b38383a6553ced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836397.312450:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000fcd9c0e8/0xf7b38383a6553ced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836397.312535:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765056:0@lo:501: 00000100:00100000:0.0:1788836397.312563:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836397.312584:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8baa284 going to sleep for 11 seconds 00000100:00100000:1.0:1788836397.312704:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765056 00000100:00100000:1.0:1788836397.312710:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765056 00000100:00100000:2.0:1788836397.327909:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836397.328288:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836397.328307:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045e5e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782765056:12345-0@lo:501: 00000100:00100000:1.0:1788836397.329358:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045e5e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782765056:12345-0@lo:501: Request processed in 1054us (16788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836397.329372:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788836397.329474:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094cbd48e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765056:0@lo:501: 00000100:00100000:3.0:1788836397.329548:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765184:0@lo:503: 00000100:00100000:3.0:1788836397.329621:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.329664:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046096a16 going to sleep for 11 seconds 00000100:00100000:2.0:1788836397.329938:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765184 00000100:00100000:2.0:1788836397.329948:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765184 00000100:00100000:2.0:1788836397.330001:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836397.330008:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b9b16c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782765184:12345-0@lo:503: 00000100:00100000:2.0:1788836397.330164:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b9b16c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782765184:12345-0@lo:503: Request processed in 157us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836397.330181:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836397.330183:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a541e913 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765184:0@lo:503: 00000100:00100000:1.0:1788836397.333605:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f3c1f18 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8018:1875730782765312:0@lo:502: 00000100:00100000:1.0:1788836397.333842:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836397.333957:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b23b706c going to sleep for 11 seconds 00000100:00100000:0.0:1788836397.334148:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765312 00000100:00100000:0.0:1788836397.334157:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765312 00000100:00100000:0.0:1788836397.334300:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836397.334311:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aecf85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8018:x1875730782765312:12345-0@lo:502: 00000100:00100000:0.0:1788836397.334505:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aecf85e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8018:x1875730782765312:12345-0@lo:502: Request processed in 195us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.334514:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788836397.334604:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f3c1f18 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8018:1875730782765312:0@lo:502: 00000020:01000000:3.0:1788836397.334641:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836397.334651:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836397.334654:0:8018:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836397.334661:0:8018:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf444f2000 00000020:00000080:3.0:1788836397.334664:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788836397.334914:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8018:1875730782765440:0@lo:502: 00000100:00100000:3.0:1788836397.334959:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.339320:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836397.340399:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765440 00000100:00100000:1.0:1788836397.340414:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765440 00000100:00100000:1.0:1788836397.340487:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836397.340844:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8018:x1875730782765440:12345-0@lo:502: 00000100:00100000:1.0:1788836397.341084:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8018:x1875730782765440:12345-0@lo:502: Request processed in 587us (6124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836397.341092:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788836397.341651:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8018:1875730782765440:0@lo:502: 00000020:01000000:3.0:1788836397.341708:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836397.341733:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836397.341735:0:8018:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836397.341741:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788836397.341840:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788836397.341864:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836397.341878:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.341890:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836397.341901:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836397.341904:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf50b59800 from 1 10000000:01000000:3.0:1788836397.341907:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836397.341944:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.341951:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.341960:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836397.341983:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765568:0@lo:101: 00000100:00100000:3.0:1788836397.342046:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.342086:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836397.342608:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765568 00000100:00100000:1.0:1788836397.342617:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765568 00000100:00100000:1.0:1788836397.342659:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836397.342669:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782765568:12345-0@lo:101: 00010000:00010000:1.0:1788836397.342783:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836397.342800:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553cfb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836397.342842:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836397.342854:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836397.342864:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb400, rc 0) 00000100:00100000:1.0:1788836397.342944:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782765568:12345-0@lo:101: Request processed in 276us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836397.342951:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836397.344503:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765568:0@lo:101: 00010000:00010000:3.0:1788836397.344538:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836397.344552:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836397.344663:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765696:0@lo:501: 00000100:00100000:3.0:1788836397.344925:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.344959:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836397.345050:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765696 00000100:00100000:0.0:1788836397.345058:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765696 00000100:00100000:0.0:1788836397.345110:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836397.345120:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782765696:12345-0@lo:501: 00000100:00100000:0.0:1788836397.345289:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782765696:12345-0@lo:501: Request processed in 169us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.345298:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836397.345352:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765696:0@lo:501: 00000100:00100000:0.0:1788836397.345389:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765824:0@lo:503: 00000100:00100000:0.0:1788836397.345433:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836397.345458:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf461119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836397.345470:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765824 00000100:00100000:0.0:1788836397.345474:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765824 00000100:00100000:0.0:1788836397.345489:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788836397.345651:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782765824:12345-0@lo:503: 00000100:00100000:0.0:1788836397.345823:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782765824:12345-0@lo:503: Request processed in 326us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.345842:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788836397.345884:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782765824:0@lo:503: 00000100:00100000:3.0:1788836397.347856:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8020:1875730782765952:0@lo:502: 00000100:00100000:3.0:1788836397.347957:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.348034:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836397.348554:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782765952 00000100:00100000:0.0:1788836397.348564:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782765952 00000100:00100000:0.0:1788836397.348625:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788836397.348636:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8020:x1875730782765952:12345-0@lo:502: 00000100:00100000:0.0:1788836397.349058:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8020:x1875730782765952:12345-0@lo:502: Request processed in 422us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.349068:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836397.349192:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8020:1875730782765952:0@lo:502: 00000020:01000000:3.0:1788836397.349242:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836397.349253:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836397.349256:0:8020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836397.349264:0:8020:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf50b59800 00000020:00000080:3.0:1788836397.349266:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788836397.349301:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8020:1875730782766080:0@lo:502: 00000100:00100000:3.0:1788836397.349344:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.349372:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836397.349818:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766080 00000100:00100000:0.0:1788836397.349834:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766080 00000100:00100000:0.0:1788836397.349881:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836397.349890:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8020:x1875730782766080:12345-0@lo:502: 00000100:00100000:0.0:1788836397.349987:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8020:x1875730782766080:12345-0@lo:502: Request processed in 98us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.349994:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836397.350628:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8020:1875730782766080:0@lo:502: 00000020:01000000:3.0:1788836397.350660:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836397.350669:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836397.350672:0:8020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836397.350818:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788836397.351186:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788836397.351214:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836397.351235:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836397.351247:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836397.443124:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836397.826119:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836397.826149:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782766208:0@lo:41: 00000100:00100000:0.0:1788836397.826227:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836397.826372:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766208 00000100:00100000:3.0:1788836397.826380:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766208 00000100:00100000:3.0:1788836397.826436:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788836397.826445:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782766208:12345-0@lo:41: 00000004:00000024:3.0:1788836397.826480:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788836397.826542:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782766208:12345-0@lo:41: Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836397.826560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836397.826682:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782766208:0@lo:41: 00010000:00010000:1.0:1788836398.464693:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836399.487747:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836400.515836:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836400.899535:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782766592:0@lo:400: 00000100:00100000:0.0:1788836400.899607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836400.899663:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836400.899669:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782766720:0@lo:400: 00000100:00100000:0.0:1788836400.899710:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836400.899784:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766592 00000100:00100000:0.0:1788836400.899791:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766592 00000100:00100000:0.0:1788836400.899838:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836400.899847:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782766592:12345-0@lo:400: 00000100:00100000:0.0:1788836400.899901:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782766592:12345-0@lo:400: Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.899909:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836400.899933:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766720 00000100:00100000:0.0:1788836400.899937:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766720 00000100:00100000:0.0:1788836400.899962:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836400.899969:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782766720:12345-0@lo:400: 00000100:00100000:0.0:1788836400.900007:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782766720:12345-0@lo:400: Request processed in 38us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.900050:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788836400.900096:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adf444fdc00 x1875730782766720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836400.900110:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782766720:0@lo:400: 00000100:00100000:0.0:1788836400.900120:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782766592:0@lo:400: 00000100:00100000:3.0:1788836400.900485:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782766464:0@lo:400: 00000100:00100000:3.0:1788836400.900515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836400.900539:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782766976:0@lo:41: 00000100:00100000:3.0:1788836400.900561:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836400.900581:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788836400.900586:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782766336:0@lo:400: 00000100:00100000:3.0:1788836400.900607:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836400.900625:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782766848:0@lo:400: 00000100:00100000:3.0:1788836400.900639:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836400.900660:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766976 00000100:00100000:3.0:1788836400.900664:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766976 00000100:00100000:3.0:1788836400.900941:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766848 00000100:00100000:3.0:1788836400.900945:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766848 00000100:00100000:3.0:1788836400.900960:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836400.900965:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782766976:12345-0@lo:41: 00000004:00000024:3.0:1788836400.900989:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788836400.901049:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782766976:12345-0@lo:41: Request processed in 83us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.901099:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836400.901113:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836400.901120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782766848:12345-0@lo:400: 00000100:00100000:3.0:1788836400.901148:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782766848:12345-0@lo:400: Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.901153:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836400.901172:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766336 00000100:00100000:3.0:1788836400.901184:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766336 00000100:00100000:3.0:1788836400.901211:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836400.901218:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3615:x1875730782766336:12345-0@lo:400: 00000100:00100000:3.0:1788836400.901247:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3615:x1875730782766336:12345-0@lo:400: Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.901253:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836400.901294:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782766336:0@lo:400: 00000100:00100000:3.0:1788836400.901304:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782766848:0@lo:400: 00000100:00100000:3.0:1788836400.901315:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782766976:0@lo:41: 00000100:00100000:0.0:1788836400.902847:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782766464 00000100:00100000:0.0:1788836400.902859:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782766464 00000100:00100000:0.0:1788836400.902911:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836400.902921:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782766464:12345-0@lo:400: 00000100:00100000:0.0:1788836400.902999:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782766464:12345-0@lo:400: Request processed in 81us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.903005:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788836400.903159:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adf444ff480 x1875730782766464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836400.903172:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782766464:0@lo:400: 00010000:00010000:0.0:1788836401.534520:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836402.561291:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836402.950640:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782767104:0@lo:41: 00000100:00100000:0.0:1788836402.950709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836402.951049:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767104 00000100:00100000:2.0:1788836402.951058:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767104 00000100:00100000:2.0:1788836402.951113:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836402.951123:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782767104:12345-0@lo:41: 00000004:00000024:2.0:1788836402.951167:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788836402.951215:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782767104:12345-0@lo:41: Request processed in 93us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.951223:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836402.951277:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782767104:0@lo:41: 00010000:00010000:0.0:1788836403.582418:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836404.606254:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836405.241239:0:8399:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836405.241242:0:8399:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788836405.241243:0:8399:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788836405.241342:0:8399:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adf7a54e000 00000020:01000004:2.0:1788836405.241354:0:8399:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788836405.241364:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836405.241374:0:8399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8adf77138000) 00000020:00000080:2.0:1788836405.241386:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836405.284308:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788836405.284377:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788836405.326488:0:8399:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788836405.326683:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788836405.326705:0:8399:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836405.326721:0:8399:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7b38383a6553d10 00000020:01000004:2.0:1788836405.326728:0:8399:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788836405.326747:0:8399:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788836405.326750:0:8399:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788836405.326756:0:8399:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788836405.326760:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788836405.326769:0:8399:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8adf7713b370) 00000020:00000080:2.0:1788836405.326778:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788836405.329407:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836405.329646:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788836405.329652:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788836405.336926:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836405.336939:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788836405.341502:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788836405.341514:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788836405.349939:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836405.350289:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836405.350295:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788836405.351325:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836405.351335:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788836405.375584:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836405.375873:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836405.375878:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788836405.376938:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836405.376947:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788836405.378630:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836405.378642:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788836405.380954:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836405.381494:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836405.381500:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788836405.382315:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836405.382334:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788836405.423764:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836405.424006:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836405.424076:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788836405.425201:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836405.425210:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788836405.425647:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788836405.425676:0:8399:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788836405.425683:0:8399:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788836405.439272:0:8399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836405.439318:0:8399:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788836405.439322:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836405.439324:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836405.439326:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836405.439327:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836405.439328:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836405.439329:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836405.439331:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836405.439333:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836405.439335:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836405.439337:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836405.439338:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836405.439343:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788836405.439345:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836405.439347:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836405.439348:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836405.439349:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836405.439350:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836405.439350:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836405.439352:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836405.439353:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836405.439354:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836405.439355:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836405.439356:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836405.439999:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788836405.440109:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782767232:0@lo:253: 00000100:00100000:3.0:1788836405.440245:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.440362:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836405.440435:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767232 00000100:00100000:2.0:1788836405.440442:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767232 00000100:00100000:2.0:1788836405.440654:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836405.440664:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8399:x1875730782767232:12345-0@lo:253: 20000000:01000000:2.0:1788836405.440716:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788836405.440720:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788836405.440725:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788836405.440728:0:6483:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788836405.440947:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836405.441191:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788836405.441206:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788836405.441234:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788836405.441241:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788836405.441253:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788836405.441266:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788836405.441342:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788836405.441355:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836405.441357:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836405.441369:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788836405.441374:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788836405.441401:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788836405.441406:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836405.441417:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788836405.441423:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788836405.441435:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788836405.441448:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788836405.441516:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788836405.441529:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836405.441531:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836405.441543:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788836405.441549:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788836405.441562:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788836405.441566:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836405.441578:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788836405.441583:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788836405.441595:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788836405.441610:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788836405.441995:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788836405.442006:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836405.442008:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836405.442066:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788836405.442075:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788836405.442090:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788836405.442096:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836405.442108:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788836405.442362:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788836405.442379:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788836405.442392:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788836405.442403:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788836405.442406:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788836405.442416:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788836405.442453:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788836405.442455:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788836405.442842:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788836405.442858:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788836405.442870:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788836405.443064:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788836405.443083:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788836405.443097:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788836405.443108:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788836405.443118:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836405.443466:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836405.443486:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836405.443499:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788836405.443625:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788836405.443645:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788836405.443657:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788836405.443667:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788836405.443669:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788836405.443956:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788836405.444207:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788836405.444225:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788836405.444238:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788836405.444247:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788836405.444249:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836405.444460:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836405.444479:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836405.444492:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788836405.444594:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788836405.444612:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788836405.444627:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1788836405.444641:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788836405.444660:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444677:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444693:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444699:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444705:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cae expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444717:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444724:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444764:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444778:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.444790:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767360:0@lo:104: 00000100:00100000:2.0:1788836405.444856:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836405.444950:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.444958:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 18 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.444967:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767488:0@lo:104: 00000100:00100000:2.0:1788836405.444989:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836405.445287:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.445295:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 18 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.445303:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767616:0@lo:104: 00000100:00100000:2.0:1788836405.445328:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836405.445374:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767360 00000100:00100000:0.0:1788836405.445381:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767360 00000100:00100000:0.0:1788836405.445451:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767488 00000100:00100000:0.0:1788836405.445455:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767488 00010000:00010000:2.0:1788836405.445538:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.445547:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 18 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.445555:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767744:0@lo:104: 00000100:00100000:2.0:1788836405.445575:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.445591:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767616 00000100:00100000:1.0:1788836405.445595:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767616 00000100:00100000:1.0:1788836405.445617:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836405.445626:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6483:x1875730782767360:12345-0@lo:104: 00010000:00010000:1.0:1788836405.445637:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445705:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836405.445712:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6483:x1875730782767360:12345-0@lo:104: Request processed in 87us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.445719:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836405.445738:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836405.445744:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782767488:12345-0@lo:104: 00010000:00010000:1.0:1788836405.445752:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445782:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836405.445787:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782767488:12345-0@lo:104: Request processed in 44us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.445793:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836405.445804:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836405.445809:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782767616:12345-0@lo:104: 00010000:00010000:1.0:1788836405.445817:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445846:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788836405.445850:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782767616:12345-0@lo:104: Request processed in 42us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.445857:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788836405.445880:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788836405.445886:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445894:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.445898:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445907:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.445914:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.445919:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.445946:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445953:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.445970:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445977:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a6553cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cdf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.445999:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836405.446002:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446008:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.446032:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446039:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.446045:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.446050:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.446063:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446069:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.446085:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446091:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40031600/0xf7b38383a6553cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cb5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446101:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836405.446104:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446129:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.446132:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446138:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.446144:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.446150:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.446165:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446171:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.446177:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446183:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c99 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446192:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.446194:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.446195:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.446202:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836405.446220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782767872:0@lo:103: 00000100:00100000:1.0:1788836405.446249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.446284:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782768000:0@lo:103: 00000100:00100000:1.0:1788836405.446313:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.446333:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836405.446339:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782768128:0@lo:103: 00000100:00100000:1.0:1788836405.446357:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.446386:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767872 00000100:00100000:1.0:1788836405.446390:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767872 00010000:00010000:1.0:1788836405.446406:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 19 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836405.446419:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768000 00000100:00100000:1.0:1788836405.446422:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768000 00010000:00010000:1.0:1788836405.446430:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 20 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836405.446439:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768128 00000100:00100000:1.0:1788836405.446442:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768128 00010000:00010000:1.0:1788836405.446449:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 21 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836405.446460:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836405.446466:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782767872:12345-0@lo:103: 00010000:00010000:1.0:1788836405.446476:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.446480:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 21 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446489:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 21 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446504:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.446531:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782767872:12345-0@lo:103: Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.446543:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836405.446558:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836405.446563:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3614:x1875730782768000:12345-0@lo:103: 00010000:00010000:1.0:1788836405.446570:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.446575:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 20 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446583:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 20 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446592:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.446617:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3614:x1875730782768000:12345-0@lo:103: Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.446623:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836405.446635:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836405.446641:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3614:x1875730782768128:12345-0@lo:103: 00010000:00010000:1.0:1788836405.446648:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.446652:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 19 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446660:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 19 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.446669:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.446701:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3614:x1875730782768128:12345-0@lo:103: Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.446707:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836405.446743:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782767872:0@lo:103: 00000100:00100000:1.0:1788836405.446776:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782768128:0@lo:103: 00000100:00100000:1.0:1788836405.446784:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782768000:0@lo:103: 00010000:00010000:2.0:1788836405.447246:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.447256:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 18 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.447267:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782768256:0@lo:104: 00000100:00100000:2.0:1788836405.447290:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.447348:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf461116c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788836405.447362:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40031a00/0xf7b38383a6553cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553cd8 expref: 18 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.447372:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767360:0@lo:104: 00010000:00010000:2.0:1788836405.447381:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6553cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553cae expref: 17 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.447389:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767488:0@lo:104: 00010000:00010000:2.0:1788836405.447397:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a6553c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553c92 expref: 16 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.447405:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767616:0@lo:104: 00000100:00100000:1.0:1788836405.447469:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782767744 00000100:00100000:1.0:1788836405.447474:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782767744 00000100:00100000:1.0:1788836405.447503:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768256 00000100:00100000:1.0:1788836405.447506:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768256 00000100:00100000:1.0:1788836405.447519:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836405.447525:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782767744:12345-0@lo:104: 00010000:00010000:1.0:1788836405.447534:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447580:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836405.447586:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782767744:12345-0@lo:104: Request processed in 61us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.447592:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836405.447607:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836405.447613:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782768256:12345-0@lo:104: 00010000:00010000:1.0:1788836405.447619:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447649:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836405.447653:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782768256:12345-0@lo:104: Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.447658:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788836405.447672:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836405.447677:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447706:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.447710:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447716:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.447722:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.447727:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.447749:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447756:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.447767:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447774:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429ea200/0xf7b38383a6553c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c61 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447785:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836405.447788:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447795:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.447798:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447814:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.447821:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.447827:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.447838:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447844:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.447849:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447856:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf82172e00/0xf7b38383a6553be3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553bea expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.447868:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.447870:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.447872:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836405.447882:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782768384:0@lo:103: 00000100:00100000:1.0:1788836405.447904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.447921:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836405.447926:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782768512:0@lo:103: 00000100:00100000:1.0:1788836405.447946:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.447965:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768384 00000100:00100000:1.0:1788836405.447968:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768384 00010000:00010000:1.0:1788836405.447981:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 16 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836405.448032:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768512 00000100:00100000:1.0:1788836405.448036:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768512 00010000:00010000:1.0:1788836405.448048:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 17 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836405.448061:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836405.448066:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3616:x1875730782768384:12345-0@lo:103: 00010000:00010000:1.0:1788836405.448074:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.448078:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 17 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448085:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 17 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448096:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.448186:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3616:x1875730782768384:12345-0@lo:103: Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.448192:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836405.448205:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836405.448210:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3616:x1875730782768512:12345-0@lo:103: 00010000:00010000:1.0:1788836405.448217:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.448220:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 16 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448228:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 16 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448238:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448251:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448262:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448269:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448276:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448281:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448285:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836405.448288:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448294:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448300:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.448307:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.448326:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3616:x1875730782768512:12345-0@lo:103: Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.448331:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836405.448378:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782768512:0@lo:103: 00000100:00100000:1.0:1788836405.448392:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782768384:0@lo:103: 00010000:00010000:1.0:1788836405.448410:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836405.448533:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82173600/0xf7b38383a6553c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553c5a expref: 15 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.448544:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782767744:0@lo:104: 00010000:00010000:2.0:1788836405.448553:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82045400/0xf7b38383a6553bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553be3 expref: 14 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.448562:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782768256:0@lo:104: 00010000:00010000:2.0:1788836405.448579:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.448588:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.448593:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.448599:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46400/0xf7b38383a6553d1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788836405.448612:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788836405.451414:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:8399:x1875730782767232:12345-0@lo:253: Request processed in 10740us (11156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836405.451430:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788836405.451513:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782767232:0@lo:253: 10000000:01000000:3.0:1788836405.451528:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788836405.451531:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836405.451533:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836405.451534:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836405.451536:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788836405.451537:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836405.451538:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836405.451669:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836405.451671:0:8399:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788836405.451672:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836405.451674:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836405.451706:0:8399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adf7a54e000 from lustre-OST0000 10000000:01000000:3.0:1788836405.451733:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788836405.451736:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836405.451744:0:8399:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adf48a1cd28 local copy 10000000:01000000:3.0:1788836405.451748:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836405.451780:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.451789:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.451809:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.451824:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782768640:0@lo:101: 00000100:00100000:3.0:1788836405.451856:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.451933:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.451969:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768640 00000100:00100000:0.0:1788836405.451975:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768640 00000100:00100000:0.0:1788836405.452271:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836405.452281:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:8399:x1875730782768640:12345-0@lo:101: 00010000:00010000:0.0:1788836405.452294:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836405.452314:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40031800/0xf7b38383a6553d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553d25 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.452335:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40031800/0xf7b38383a6553d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553d25 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.452344:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40031800/0xf7b38383a6553d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d25 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.452352:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031800, rc 0) 00000100:00100000:0.0:1788836405.452420:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782768640:12345-0@lo:101: Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.452425:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836405.452499:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782768640:0@lo:101: 00010000:00010000:2.0:1788836405.452513:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.452524:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.452708:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782768768:0@lo:501: 00000100:00100000:2.0:1788836405.452735:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.452765:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836405.452807:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768768 00000100:00100000:3.0:1788836405.452811:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768768 00000100:00100000:3.0:1788836405.452844:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788836405.452850:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782768768:12345-0@lo:501: 00000100:00100000:3.0:1788836405.452912:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782768768:12345-0@lo:501: Request processed in 61us (175us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836405.452918:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788836405.452998:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782768768:0@lo:501: 10000000:01000000:2.0:1788836405.453037:0:8399:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788836405.453054:0:8399:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788836405.453060:0:8399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.453068:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.453075:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.453091:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836405.453267:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836405.453274:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453281:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836405.453285:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453293:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836405.453299:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836405.453305:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836405.453322:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453327:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836405.453352:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453358:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a6553d25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553d2c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453372:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.453373:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836405.453375:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836405.453387:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836405.453397:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782768896:0@lo:103: 00000100:00100000:1.0:1788836405.453425:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.453454:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782768896 00000100:00100000:1.0:1788836405.453457:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782768896 00000100:00100000:1.0:1788836405.453482:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836405.453488:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3615:x1875730782768896:12345-0@lo:103: 00010000:00010000:1.0:1788836405.453496:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836405.453506:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40031800/0xf7b38383a6553d2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553d25 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.453518:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836405.453540:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:3615:x1875730782768896:12345-0@lo:103: Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.453546:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836405.453572:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782768896:0@lo:103: 10000000:01000000:2.0:1788836405.453697:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf7a54e000 10000000:01000000:2.0:1788836405.453702:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788836405.453707:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788836405.453709:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836405.453713:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788836405.453715:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836405.453731:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.453738:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.453756:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.453767:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769024:0@lo:101: 00000100:00100000:2.0:1788836405.453790:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.453840:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.453966:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769024 00000100:00100000:0.0:1788836405.453970:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769024 00000100:00100000:0.0:1788836405.454001:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836405.454007:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+13:8399:x1875730782769024:12345-0@lo:101: 00010000:00010000:0.0:1788836405.454037:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836405.454049:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553d33 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.454063:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.454071:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.454078:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836405.454258:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769024:0@lo:101: 00010000:00010000:2.0:1788836405.454269:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.454278:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.454335:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769152:0@lo:501: 00000100:00100000:2.0:1788836405.454358:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.454367:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.454395:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769024:12345-0@lo:101: Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.454412:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836405.454433:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769152 00000100:00100000:0.0:1788836405.454436:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769152 00000100:00100000:0.0:1788836405.454449:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836405.454454:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769152:12345-0@lo:501: 00000100:00100000:0.0:1788836405.454560:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769152:12345-0@lo:501: Request processed in 105us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.454566:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836405.454755:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769152:0@lo:501: 00000100:00100000:2.0:1788836405.454780:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769280:0@lo:503: 00000100:00100000:2.0:1788836405.454819:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.454829:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.454880:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769280 00000100:00100000:0.0:1788836405.454884:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769280 00000100:00100000:0.0:1788836405.454911:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836405.454917:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769280:12345-0@lo:503: 00000100:00100000:0.0:1788836405.454997:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769280:12345-0@lo:503: Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.455005:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836405.455307:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769280:0@lo:503: 00000040:00080000:2.0:1788836405.455550:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836405.455737:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769408:0@lo:502: 00000100:00100000:2.0:1788836405.455776:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.455800:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.455866:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769408 00000100:00100000:0.0:1788836405.455871:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769408 00000100:00100000:0.0:1788836405.455890:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788836405.455896:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769408:12345-0@lo:502: 00000100:00100000:0.0:1788836405.455977:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769408:12345-0@lo:502: Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.455984:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836405.456102:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769408:0@lo:502: 00000040:00080000:2.0:1788836405.456397:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788836405.456420:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788836405.456431:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788836405.456441:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788836405.456451:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788836405.456461:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788836405.456479:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769536:0@lo:502: 00000100:00100000:2.0:1788836405.456511:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.456527:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.456682:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769536 00000100:00100000:0.0:1788836405.456696:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769536 00000100:00100000:0.0:1788836405.456714:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836405.456720:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769536:12345-0@lo:502: 00000100:00100000:0.0:1788836405.456797:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769536:12345-0@lo:502: Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.456803:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788836405.456943:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769536:0@lo:502: 00000040:00080000:2.0:1788836405.456980:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788836405.456988:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788836405.457964:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788836405.457974:0:8422:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788836405.457981:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836405.457983:0:8422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788836405.457989:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836405.458006:0:8422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8adf48a199b8) 00000020:00000080:1.0:1788836405.458234:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788836405.458247:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836405.458322:0:8422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7a54e000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788836405.458330:0:8422:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836405.458336:0:8422:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7b38383a6553d48 00010000:00010000:1.0:1788836405.463934:0:8422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788836405.464505:0:8422:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788836405.467384:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788836405.467768:0:8422:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788836405.470551:0:8422:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788836405.471785:0:8422:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788836405.478448:0:8422:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788836405.481842:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788836405.481854:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836405.481860:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836405.481862:0:8422:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788836405.481866:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836405.481869:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836405.481870:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836405.481873:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836405.481875:0:8422:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836405.481900:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836405.481903:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836405.481904:0:8422:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788836405.481907:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788836405.485314:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788836405.485370:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788836405.485443:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.485458:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836405.485467:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7a54e000 from 1 10000000:01000000:2.0:1788836405.485471:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836405.485515:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.485523:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836405.485535:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.485587:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769664:0@lo:101: 00000100:00100000:2.0:1788836405.485655:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.485716:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836405.485810:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769664 00000100:00100000:3.0:1788836405.485818:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769664 00000100:00100000:3.0:1788836405.485859:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788836405.485868:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:8399:x1875730782769664:12345-0@lo:101: 00010000:00010000:3.0:1788836405.485880:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836405.485893:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553d4f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.485916:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.485927:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.485936:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700a00, rc 0) 00000100:00100000:3.0:1788836405.485983:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782769664:12345-0@lo:101: Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836405.485989:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788836405.486073:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769664:0@lo:101: 00010000:00010000:3.0:1788836405.486086:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.486094:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.486317:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769792:0@lo:501: 00000100:00100000:3.0:1788836405.486345:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.486367:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836405.486382:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769792 00000100:00100000:3.0:1788836405.486386:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769792 00000100:00100000:3.0:1788836405.486424:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836405.486430:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782769792:12345-0@lo:501: 00000100:00100000:3.0:1788836405.486523:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782769792:12345-0@lo:501: Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836405.486530:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836405.486781:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769792:0@lo:501: 00000100:00100000:3.0:1788836405.486807:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769920:0@lo:503: 00000100:00100000:3.0:1788836405.486843:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.486855:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836405.486866:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782769920 00000100:00100000:3.0:1788836405.486869:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782769920 00000100:00100000:3.0:1788836405.486884:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836405.486896:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782769920:12345-0@lo:503: 00000100:00100000:3.0:1788836405.486968:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782769920:12345-0@lo:503: Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836405.486974:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836405.487032:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782769920:0@lo:503: 00000040:00080000:3.0:1788836405.487435:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836405.487506:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770048:0@lo:502: 00000100:00100000:3.0:1788836405.487540:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.487575:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.487647:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770048 00000100:00100000:0.0:1788836405.487652:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770048 00000100:00100000:0.0:1788836405.487721:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788836405.487731:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782770048:12345-0@lo:502: 00000100:00100000:0.0:1788836405.487813:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782770048:12345-0@lo:502: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.487821:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788836405.489357:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770048:0@lo:502: 00000040:00080000:3.0:1788836405.489592:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788836405.489620:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788836405.489649:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770176:0@lo:502: 00000100:00100000:3.0:1788836405.489713:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.489752:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770176 00000100:00100000:3.0:1788836405.489758:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770176 00000100:00100000:3.0:1788836405.489801:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836405.489809:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782770176:12345-0@lo:502: 00000100:00100000:3.0:1788836405.489903:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782770176:12345-0@lo:502: Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836405.489911:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836405.489951:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836405.489963:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770176:0@lo:502: 00000040:00080000:3.0:1788836405.489998:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788836405.490005:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788836405.491373:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836405.491384:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836405.491386:0:8426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788836405.491393:0:8426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf7a54e000 00000020:00000080:0.0:1788836405.491396:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836405.491406:0:8426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836405.491409:0:8426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836405.491411:0:8426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788836405.491414:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788836405.491522:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788836405.491561:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836405.491580:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.491591:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836405.491630:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788836405.491632:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf7a54e000 10000000:01000000:3.0:1788836405.491635:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf7a54e000 10000000:01000000:3.0:1788836405.491638:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836405.491644:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf7a54e000 from 1 10000000:01000000:3.0:1788836405.491646:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788836405.491677:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.491693:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.491703:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.491722:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770304:0@lo:101: 00000100:00100000:3.0:1788836405.491776:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.491813:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.491914:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770304 00000100:00100000:0.0:1788836405.491920:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770304 00000100:00100000:0.0:1788836405.491953:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788836405.491962:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8399:x1875730782770304:12345-0@lo:101: 00010000:00010000:0.0:1788836405.491975:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836405.491987:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553d5d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.492040:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.492063:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.492072:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031400, rc 0) 00000100:00100000:0.0:1788836405.492108:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770304:12345-0@lo:101: Request processed in 147us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.492229:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836405.492359:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770304:0@lo:101: 00010000:00010000:3.0:1788836405.492374:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.492383:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.492467:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770432:0@lo:501: 00000100:00100000:3.0:1788836405.492492:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.492523:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.492621:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770432 00000100:00100000:0.0:1788836405.492625:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770432 00000100:00100000:0.0:1788836405.492654:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836405.492661:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770432:12345-0@lo:501: 00000100:00100000:0.0:1788836405.492777:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770432:12345-0@lo:501: Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.492784:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788836405.492841:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770432:0@lo:501: 00000100:00100000:1.0:1788836405.492869:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770560:0@lo:503: 00000100:00100000:1.0:1788836405.492905:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.492929:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.492964:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770560 00000100:00100000:0.0:1788836405.492969:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770560 00000100:00100000:0.0:1788836405.492996:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836405.493003:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770560:12345-0@lo:503: 00000100:00100000:0.0:1788836405.493102:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770560:12345-0@lo:503: Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.493268:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770560:0@lo:503: 00000040:00080000:1.0:1788836405.493484:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836405.493551:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770688:0@lo:502: 00000100:00100000:1.0:1788836405.493585:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.493610:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770688 00000100:00100000:1.0:1788836405.493614:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770688 00000100:00100000:0.0:1788836405.493763:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836405.494287:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836405.496324:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788836405.496347:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770688:12345-0@lo:502: 00000100:00100000:1.0:1788836405.496561:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770688:12345-0@lo:502: Request processed in 224us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.496568:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788836405.496817:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770688:0@lo:502: 00000040:00080000:2.0:1788836405.497067:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788836405.497096:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788836405.497107:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788836405.497275:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788836405.497286:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788836405.497297:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788836405.497307:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788836405.497317:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788836405.497329:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788836405.497339:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788836405.497349:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788836405.497359:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788836405.497369:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788836405.497379:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788836405.497389:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788836405.497398:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788836405.497408:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788836405.497418:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788836405.497428:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788836405.497438:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788836405.497448:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788836405.497471:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788836405.497482:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788836405.497492:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788836405.497502:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788836405.497520:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788836405.497529:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788836405.497550:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788836405.497562:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788836405.497572:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788836405.497583:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788836405.497595:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788836405.497607:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788836405.497619:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788836405.497631:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788836405.497643:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788836405.497654:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788836405.497703:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770816:0@lo:502: 00000100:00100000:2.0:1788836405.497747:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.497786:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.497890:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770816 00000100:00100000:0.0:1788836405.497897:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770816 00000100:00100000:0.0:1788836405.497936:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788836405.497944:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770816:12345-0@lo:502: 00000100:00100000:0.0:1788836405.498077:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782770816:12345-0@lo:502: Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.498084:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788836405.498275:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782770816:0@lo:502: 00000040:00080000:2.0:1788836405.498316:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788836405.498325:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788836405.498862:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788836405.498885:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ade42544d28) 00000020:00000080:2.0:1788836405.498907:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788836405.498991:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7a54e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788836405.498996:0:8427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7a54e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788836405.498999:0:8427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7a54e000 3 00010000:00080000:2.0:1788836405.499057:0:8427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade41e65800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788836405.502341:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788836405.502601:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788836405.502645:0:8427:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788836405.502657:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7b38383a6553d72 00000100:00080000:2.0:1788836405.502668:0:8427:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836405.502679:0:8427:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ade41e65800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836405.502791:0:8427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade41ebea00 x1875730782770944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836405.502818:0:8427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788836405.503271:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782770944:0@lo:38: 00000100:00100000:1.0:1788836405.503354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.503435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782771200:0@lo:400: 00000100:00100000:1.0:1788836405.503466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.503488:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836405.503494:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782771328:0@lo:400: 00000100:00100000:1.0:1788836405.503514:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.503633:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771200 00000100:00100000:1.0:1788836405.503641:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771200 00000100:00100000:1.0:1788836405.503699:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836405.503710:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782771200:12345-0@lo:400: 00000100:00100000:1.0:1788836405.503765:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782771200:12345-0@lo:400: Request processed in 57us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.503771:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836405.503800:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782770944 00000100:00100000:1.0:1788836405.503803:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782770944 00000100:00100000:1.0:1788836405.503818:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771328 00000100:00100000:1.0:1788836405.503820:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771328 00000100:00100000:1.0:1788836405.503835:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836405.503840:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782771328:12345-0@lo:400: 00000100:00100000:1.0:1788836405.503865:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782771328:12345-0@lo:400: Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.503869:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836405.503880:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836405.503893:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782770944:12345-0@lo:38: 00010000:00080000:1.0:1788836405.503911:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788836405.503941:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7b38383a6553d79 00000004:00100000:1.0:1788836405.503955:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836405.503984:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836405.504050:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875730782770944:12345-0@lo:38: Request processed in 155us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.504056:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788836405.504093:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adf77368380 x1875730782771328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836405.504105:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782771328:0@lo:400: 00000100:00100000:2.0:1788836405.504318:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782771072:0@lo:400: 00000100:00100000:2.0:1788836405.504347:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836405.504366:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836405.504372:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782771456:0@lo:400: 00000100:00100000:2.0:1788836405.504390:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836405.504438:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771456 00000100:00100000:0.0:1788836405.504442:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771456 00000100:00100000:0.0:1788836405.504472:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836405.504478:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782771456:12345-0@lo:400: 00000100:00100000:0.0:1788836405.504516:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782771456:12345-0@lo:400: Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.504523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836405.504558:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782771456:0@lo:400: 00000100:00100000:1.0:1788836405.504704:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782771200:0@lo:400: 00000100:00100000:1.0:1788836405.504726:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771072 00000100:00100000:1.0:1788836405.504729:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771072 00000100:00100000:1.0:1788836405.504758:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836405.504765:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782771072:12345-0@lo:400: 00000100:00100000:1.0:1788836405.504861:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782771072:12345-0@lo:400: Request processed in 95us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836405.504867:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788836405.504895:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade41ebea00 x1875730782770944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836405.504903:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836405.504909:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788836405.504915:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836405.504919:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836405.504931:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836405.504936:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782770944:0@lo:38: 00000020:01000004:0.0:1788836405.505516:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788836405.505531:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8adf442a19b8) 00000020:00000080:0.0:1788836405.505558:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788836405.505642:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7a54e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788836405.505646:0:8427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7a54e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788836405.505648:0:8427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7a54e000 3 00010000:00080000:0.0:1788836405.505673:0:8427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade4252a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836405.512404:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788836405.513738:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788836405.513777:0:8427:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836405.513790:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf7b38383a6553d87 00000100:00080000:0.0:1788836405.513799:0:8427:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836405.513804:0:8427:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ade4252a000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836405.513833:0:8427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77368a80 x1875730782771584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836405.513857:0:8427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1788836405.514100:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adf7736b100 x1875730782771072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836405.514225:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782771072:0@lo:400: 00000100:00100000:1.0:1788836405.515662:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782771584:0@lo:38: 00000100:00100000:1.0:1788836405.515747:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788836405.518370:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788836405.521750:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771584 00000100:00100000:0.0:1788836405.521766:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771584 00000100:00100000:0.0:1788836405.522792:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836405.522802:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875730782771584:12345-0@lo:38: 00010000:00080000:0.0:1788836405.522834:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1788836405.522868:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf7b38383a6553d8e 00000004:00100000:0.0:1788836405.522884:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836405.522915:0:6492:0:(import.c:65:import_set_state_nolock()) ffff8ade4252e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836405.523007:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875730782771584:12345-0@lo:38: Request processed in 204us (7258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.523036:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788836405.523482:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adf77368a80 x1875730782771584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836405.523493:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836405.523502:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788836405.523509:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836405.523513:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788836405.523516:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade4252a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836405.523522:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782771584:0@lo:38: 00000020:01000000:1.0:1788836405.524081:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788836405.524136:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836405.524155:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836405.524167:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836405.524216:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836405.524218:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836405.524219:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836405.524221:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836405.524222:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836405.524223:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836405.524224:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836405.524226:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836405.524231:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836405.524233:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836405.524234:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836405.524238:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788836405.524240:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836405.524241:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836405.524242:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836405.524243:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836405.524244:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836405.524245:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836405.524246:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836405.524247:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836405.524248:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836405.524249:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836405.524249:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836405.524268:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788836405.524283:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782771712:0@lo:253: 00000100:00100000:1.0:1788836405.524329:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836405.524362:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.524710:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771712 00000100:00100000:0.0:1788836405.524717:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771712 00000100:00100000:0.0:1788836405.524782:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836405.524790:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782771712:12345-0@lo:253: 20000000:01000000:0.0:1788836405.524811:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788836405.524822:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836405.530635:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836405.530654:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788836405.531047:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:8399:x1875730782771712:12345-0@lo:253: Request processed in 6254us (6713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.531059:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 20000000:01000000:3.0:1788836405.531296:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836405.531301:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836405.531321:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531334:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531341:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531347:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531380:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531394:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 15 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.531407:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782771840:0@lo:104: 00000100:00100000:3.0:1788836405.531443:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836405.531478:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836405.531486:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836405.531505:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782771968:0@lo:104: 00000100:00100000:3.0:1788836405.531523:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42789c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836405.531721:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788836405.531737:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836405.531755:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771840 00000100:00100000:0.0:1788836405.531762:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771840 00000100:00100000:0.0:1788836405.531801:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782771968 00000100:00100000:0.0:1788836405.531804:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782771968 00000100:00100000:0.0:1788836405.531817:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836405.531831:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77265050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782771840:12345-0@lo:104: 00010000:00010000:0.0:1788836405.531843:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.531894:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836405.531900:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77265050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782771840:12345-0@lo:104: Request processed in 70us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.531906:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836405.531935:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836405.531941:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782771968:12345-0@lo:104: 00010000:00010000:0.0:1788836405.531949:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.531980:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836405.531985:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782771968:12345-0@lo:104: Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.531991:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836405.532055:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782771840:0@lo:104: 00000100:00100000:0.0:1788836405.532075:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782771968:0@lo:104: 00010000:00010000:0.0:1788836405.532096:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836405.532335:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8399:1875730782771712:0@lo:253: 10000000:01000000:2.0:1788836405.532345:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836405.532348:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836405.532350:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836405.532351:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836405.532353:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836405.532354:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836405.532356:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836405.532357:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836405.532359:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836405.532360:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836405.532362:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836405.532364:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836405.532374:0:8399:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788836405.534259:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836405.534271:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534282:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836405.534287:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534311:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836405.534318:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836405.534323:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836405.534374:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534381:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836405.534402:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534410:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ca7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534427:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836405.534431:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534436:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836405.534439:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534447:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836405.534453:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836405.534465:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836405.534477:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534482:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836405.534495:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534502:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030400/0xf7b38383a6553c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553c8b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.534516:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836405.534518:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836405.534520:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836405.534545:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836405.534560:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782772096:0@lo:103: 00000100:00100000:0.0:1788836405.534615:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836405.535474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782772224:0@lo:103: 00000100:00100000:3.0:1788836405.535512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836405.536212:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772096 00000100:00100000:0.0:1788836405.536221:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772096 00010000:00010000:0.0:1788836405.536252:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 16 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836405.536285:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772224 00000100:00100000:0.0:1788836405.536289:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772224 00010000:00010000:0.0:1788836405.536300:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 17 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836405.536314:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836405.536322:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3615:x1875730782772096:12345-0@lo:103: 00010000:00010000:0.0:1788836405.536348:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836405.536354:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 17 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536366:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 17 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536383:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ca0 expref: 17 pid: 6483 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536399:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836405.536442:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3615:x1875730782772096:12345-0@lo:103: Request processed in 120us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.536449:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836405.536465:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836405.536470:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3616:x1875730782772224:12345-0@lo:103: 00010000:00010000:0.0:1788836405.536479:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836405.536484:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536492:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536502:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eaa00/0xf7b38383a6553c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553c84 expref: 15 pid: 6485 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536513:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.536522:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836405.537249:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009471915s 00010000:00010000:0.0:1788836405.537255:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537263:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537271:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537279:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537285:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836405.537290:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537298:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537316:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537326:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836405.537369:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:3616:x1875730782772224:12345-0@lo:103: Request processed in 898us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836405.537376:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836405.537420:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782772224:0@lo:103: 00000100:00100000:0.0:1788836405.537451:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782772096:0@lo:103: 00010000:00010000:0.0:1788836405.537476:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537483:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836405.537489:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701a00/0xf7b38383a6553d95 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788836405.545461:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788836405.545752:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788836405.545927:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788836405.547173:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788836405.547444:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788836405.547701:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788836405.549460:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788836405.558931:0:8399:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788836405.558941:0:8399:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788836405.558986:0:8399:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788836405.559360:0:8399:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788836405.559385:0:8399:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788836405.559404:0:8399:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788836405.562394:0:8399:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836405.563786:0:8399:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788836405.647531:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836406.014465:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782772352:0@lo:41: 00000100:00100000:1.0:1788836406.014560:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.014817:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772352 00000100:00100000:2.0:1788836406.014827:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772352 00000100:00100000:2.0:1788836406.014886:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836406.014895:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782772352:12345-0@lo:41: 00000004:00000024:2.0:1788836406.014935:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788836406.014992:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782772352:12345-0@lo:41: Request processed in 98us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.014999:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836406.015096:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782772352:0@lo:41: 10000000:01000000:2.0:1788836406.532348:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788836406.532355:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf444f2000 from 30 10000000:01000000:2.0:1788836406.532360:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836406.532410:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.532424:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.532436:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.532461:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772480:0@lo:101: 00000100:00100000:2.0:1788836406.532567:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.538996:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.539226:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772480 00000100:00100000:0.0:1788836406.539236:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772480 00000100:00100000:0.0:1788836406.539305:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788836406.539315:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:6487:x1875730782772480:12345-0@lo:101: 00010000:00010000:0.0:1788836406.539335:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836406.539355:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553d9c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.539385:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.539395:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.539414:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030400, rc 0) 00000100:00100000:0.0:1788836406.539476:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782772480:12345-0@lo:101: Request processed in 163us (6919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.539483:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788836406.540297:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772480:0@lo:101: 00010000:00010000:2.0:1788836406.540319:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.540342:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.540420:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772608:0@lo:501: 00000100:00100000:2.0:1788836406.540461:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.540495:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.540757:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772608 00000100:00100000:0.0:1788836406.540762:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772608 00000100:00100000:0.0:1788836406.540918:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836406.540927:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782772608:12345-0@lo:501: 00000100:00100000:0.0:1788836406.541978:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782772608:12345-0@lo:501: Request processed in 1047us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.541988:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788836406.542745:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772608:0@lo:501: 00000100:00100000:2.0:1788836406.542881:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772736:0@lo:503: 00000100:00100000:2.0:1788836406.542934:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.542979:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836406.543274:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772736 00000100:00100000:3.0:1788836406.543281:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772736 00000100:00100000:3.0:1788836406.543325:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788836406.543332:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782772736:12345-0@lo:503: 00000100:00100000:3.0:1788836406.543450:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782772736:12345-0@lo:503: Request processed in 118us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.543457:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836406.543556:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782772736:0@lo:503: 00000100:00100000:2.0:1788836406.548368:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8481:1875730782772864:0@lo:502: 00000100:00100000:2.0:1788836406.548451:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.548528:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836406.551633:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772864 00000100:00100000:1.0:1788836406.551648:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772864 00000100:00100000:1.0:1788836406.551724:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788836406.551733:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8481:x1875730782772864:12345-0@lo:502: 00000100:00100000:1.0:1788836406.551911:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8481:x1875730782772864:12345-0@lo:502: Request processed in 179us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836406.551918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836406.552089:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8481:1875730782772864:0@lo:502: 00000100:00100000:0.0:1788836406.552167:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8481:1875730782772992:0@lo:502: 00000100:00100000:0.0:1788836406.552214:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.552247:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836406.552405:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782772992 00000100:00100000:1.0:1788836406.552410:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782772992 00000100:00100000:1.0:1788836406.552439:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788836406.552445:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8481:x1875730782772992:12345-0@lo:502: 00000100:00100000:1.0:1788836406.552511:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:8481:x1875730782772992:12345-0@lo:502: Request processed in 66us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836406.552523:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788836406.552890:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8481:1875730782772992:0@lo:502: 00000040:00080000:0.0:1788836406.552911:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788836406.553125:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788836406.553158:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836406.553168:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836406.553178:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836406.553187:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836406.553189:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf444f2000 from 5 10000000:01000000:3.0:1788836406.553192:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836406.553219:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836406.553227:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836406.553243:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836406.553257:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773120:0@lo:101: 00000100:00100000:3.0:1788836406.553287:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.553312:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c569c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836406.553596:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773120 00000100:00100000:1.0:1788836406.553601:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773120 00000100:00100000:1.0:1788836406.553633:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788836406.553639:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782773120:12345-0@lo:101: 00010000:00010000:1.0:1788836406.553648:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836406.553661:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553daa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836406.553698:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836406.553707:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836406.553715:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb600, rc 0) 00000100:00100000:1.0:1788836406.553956:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782773120:12345-0@lo:101: Request processed in 317us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836406.553963:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788836406.558541:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773120:0@lo:101: 00010000:00010000:0.0:1788836406.558579:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.558591:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836406.558684:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773248:0@lo:256: 00000100:00100000:0.0:1788836406.558748:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.558801:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.560283:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773248 00000100:00100000:2.0:1788836406.560297:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773248 00000100:00100000:2.0:1788836406.560367:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836406.560377:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782773248:12345-0@lo:256: 20000000:01000000:2.0:1788836406.560404:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836406.560430:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836406.560434:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788836406.560565:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782773248:12345-0@lo:256: Request processed in 183us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.560573:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788836406.560740:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773248:0@lo:256: 10000000:01000000:0.0:1788836406.560803:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836406.560813:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.560822:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836406.560829:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788836406.560832:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788836406.560834:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788836406.560862:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.560869:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.560877:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836406.560892:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773376:0@lo:101: 00000100:00100000:0.0:1788836406.560921:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.560948:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.561132:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773376 00000100:00100000:2.0:1788836406.561137:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773376 00000100:00100000:2.0:1788836406.561167:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788836406.561182:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782773376:12345-0@lo:101: 00010000:00010000:2.0:1788836406.561191:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836406.561202:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553db8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.561224:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.561234:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.561242:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47c00, rc 0) 00000100:00100000:2.0:1788836406.561272:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782773376:12345-0@lo:101: Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.561278:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788836406.561466:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773376:0@lo:101: 00010000:00010000:0.0:1788836406.561486:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.561496:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836406.561550:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773504:0@lo:501: 00000100:00100000:0.0:1788836406.561591:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.561613:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.561891:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773504 00000100:00100000:2.0:1788836406.561896:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773504 00000100:00100000:2.0:1788836406.561928:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788836406.561934:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782773504:12345-0@lo:501: 00000100:00100000:2.0:1788836406.562082:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782773504:12345-0@lo:501: Request processed in 147us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.562365:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788836406.562446:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773504:0@lo:501: 00000100:00100000:0.0:1788836406.562477:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773632:0@lo:503: 00000100:00100000:0.0:1788836406.562515:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.562545:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.562707:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773632 00000100:00100000:2.0:1788836406.562711:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773632 00000100:00100000:2.0:1788836406.562740:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788836406.562746:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782773632:12345-0@lo:503: 00000100:00100000:2.0:1788836406.562992:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782773632:12345-0@lo:503: Request processed in 245us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.563008:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788836406.563221:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782773632:0@lo:503: 00000100:00100000:3.0:1788836406.564342:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8484:1875730782773760:0@lo:502: 00000100:00100000:3.0:1788836406.564397:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.564468:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.565204:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773760 00000100:00100000:0.0:1788836406.565213:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773760 00000100:00100000:0.0:1788836406.565287:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836406.565295:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8484:x1875730782773760:12345-0@lo:502: 00000100:00100000:0.0:1788836406.565425:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8484:x1875730782773760:12345-0@lo:502: Request processed in 130us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.565432:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836406.565511:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8484:1875730782773760:0@lo:502: 00000020:01000000:3.0:1788836406.565551:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836406.565566:0:8484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788836406.565573:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836406.565575:0:8484:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788836406.565580:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836406.565584:0:8484:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:3.0:1788836406.565608:0:8484:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788836406.565611:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836406.565635:0:8484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8adf817b3370) 00000020:00000080:3.0:1788836406.565659:0:8484:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788836406.565677:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836406.565770:0:8484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788836406.565786:0:8484:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788836406.565793:0:8484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553dcd 00010000:00080000:3.0:1788836406.565821:0:8484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf7fb58000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788836406.566056:0:8484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788836406.580290:0:8484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788836406.580314:0:8484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788836406.580507:0:8484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836406.580938:0:8484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836406.581085:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788836406.587373:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000020:00000004:3.0:1788836406.590516:0:8485:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836406.591587:0:8485:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788836406.594275:0:8486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836406.594284:0:8486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788836406.601918:0:8484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788836406.601933:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836406.601981:0:8484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788836406.602007:0:8484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553dd4 00000100:00080000:2.0:1788836406.602408:0:8484:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836406.602413:0:8484:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8adf7fb58000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836406.602449:0:8484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade41ebf100 x1875730782773888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836406.602481:0:8484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788836406.602978:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836406.602984:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.602986:0:8484:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788836406.602989:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836406.602993:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.602994:0:8484:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836406.602997:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836406.602999:0:8484:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788836406.603056:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8484:1875730782774016:0@lo:502: 00000100:00100000:3.0:1788836406.603412:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782773888:0@lo:8: 00000100:00100000:3.0:1788836406.603474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.603627:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.603646:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836406.603875:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782773888 00000100:00100000:1.0:1788836406.603882:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782773888 00000100:00100000:1.0:1788836406.603919:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836406.603925:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782773888:12345-0@lo:8: 00010000:00080000:1.0:1788836406.603951:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1788836406.603979:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553ddb 00002000:00100000:1.0:1788836406.604042:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8adf7a4a5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788836406.604051:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788836406.604055:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788836406.604217:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774016 00000100:00100000:2.0:1788836406.604222:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774016 00000100:00100000:2.0:1788836406.604255:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836406.604262:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8484:x1875730782774016:12345-0@lo:502: 00000100:00100000:2.0:1788836406.604380:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:8484:x1875730782774016:12345-0@lo:502: Request processed in 118us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.604397:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836406.604453:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8484:1875730782774016:0@lo:502: 00000020:01000000:2.0:1788836406.604478:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836406.604484:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.604487:0:8484:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788836406.604491:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00002000:00100000:1.0:1788836406.604637:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788836406.605080:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:0.0:1788836406.605434:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782774272:0@lo:400: 00000100:00100000:0.0:1788836406.605481:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.605505:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782774784:0@lo:400: 00000100:00100000:0.0:1788836406.605528:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.605561:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788836406.605567:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782774144:0@lo:400: 00000100:00100000:0.0:1788836406.605587:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.605604:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782774656:0@lo:400: 00000100:00100000:0.0:1788836406.605626:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.605649:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782774400:0@lo:400: 00000100:00100000:3.0:1788836406.605929:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782774528:0@lo:400: 00000100:00080000:1.0:1788836406.605989:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836406.606403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.607259:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774272 00000100:00100000:2.0:1788836406.607269:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774272 00000100:00100000:2.0:1788836406.607314:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774528 00000100:00100000:2.0:1788836406.607317:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774528 00000100:00100000:2.0:1788836406.607334:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836406.607342:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782774272:12345-0@lo:400: 00000100:00100000:2.0:1788836406.607404:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782774272:12345-0@lo:400: Request processed in 62us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.607411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836406.607426:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836406.607432:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782774528:12345-0@lo:400: 00000100:00100000:2.0:1788836406.607466:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782774528:12345-0@lo:400: Request processed in 34us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.607472:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836406.607513:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782774272:0@lo:400: 00000100:00100000:2.0:1788836406.607543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782774528:0@lo:400: 00000100:00100000:2.0:1788836406.608079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774784 00000100:00100000:2.0:1788836406.608085:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774784 00000100:00100000:2.0:1788836406.608135:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774144 00000100:00100000:2.0:1788836406.608139:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774144 00000100:00100000:2.0:1788836406.608150:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774656 00000100:00100000:2.0:1788836406.608160:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774656 00000100:00100000:2.0:1788836406.608180:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836406.608186:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782774784:12345-0@lo:400: 00000100:00100000:2.0:1788836406.608229:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782774784:12345-0@lo:400: Request processed in 43us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.608234:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836406.608244:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836406.608249:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782774144:12345-0@lo:400: 00000100:00100000:2.0:1788836406.608272:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782774144:12345-0@lo:400: Request processed in 23us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.608277:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836406.608284:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836406.608289:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782774656:12345-0@lo:400: 00000100:00100000:2.0:1788836406.608309:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782774656:12345-0@lo:400: Request processed in 20us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.608313:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788836406.608345:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77369c00 x1875730782774144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836406.608355:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782774144:0@lo:400: 00010000:00080000:2.0:1788836406.608367:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77368000 x1875730782774656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836406.608375:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782774656:0@lo:400: 00010000:00080000:2.0:1788836406.608386:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77368e00 x1875730782774784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836406.608392:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782774784:0@lo:400: 00000100:00080000:3.0:1788836406.608628:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836406.608632:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836406.611803:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.611902:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774400 00000100:00100000:0.0:1788836406.611912:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774400 00000100:00100000:0.0:1788836406.611967:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836406.611977:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782774400:12345-0@lo:400: 00000100:00100000:0.0:1788836406.612078:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782774400:12345-0@lo:400: Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.612086:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788836406.612397:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77369180 x1875730782774400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.612413:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782774400:0@lo:400: 00000020:01000000:0.0:1788836406.612449:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788836406.612482:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788836406.612493:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.612503:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836406.612523:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788836406.612525:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf50b59800 from 30 10000000:01000000:0.0:1788836406.612528:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836406.612559:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.612567:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.612576:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836406.612596:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782774912:0@lo:101: 00000100:00100000:0.0:1788836406.612635:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.612706:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.620682:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782774912 00000100:00100000:2.0:1788836406.620695:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782774912 00000100:00100000:2.0:1788836406.620748:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836406.620757:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782774912:12345-0@lo:101: 00010000:00010000:2.0:1788836406.620775:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836406.620862:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553de2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.620891:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.620903:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.620913:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47e00, rc 0) 00000100:00100000:2.0:1788836406.620997:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782774912:12345-0@lo:101: Request processed in 240us (8361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.621004:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836406.621085:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782774912:0@lo:101: 00010000:00010000:2.0:1788836406.621857:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.621868:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.621943:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775040:0@lo:501: 00000100:00100000:2.0:1788836406.621977:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.622001:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775040 00000100:00100000:2.0:1788836406.622033:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775040 00000100:00100000:2.0:1788836406.622061:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836406.622068:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782775040:12345-0@lo:501: 00000100:00100000:1.0:1788836406.623482:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782773888:12345-0@lo:8: Request processed in 17844us (18296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836406.623502:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788836406.623649:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebf100 x1875730782773888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.623661:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836406.623680:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788836406.623689:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836406.623695:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788836406.623699:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7fb58000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836406.623723:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836406.623730:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782773888:0@lo:8: 00000100:00100000:2.0:1788836406.624623:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782775040:12345-0@lo:501: Request processed in 2552us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.624632:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836406.624695:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.624710:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775040:0@lo:501: 00000100:00100000:2.0:1788836406.624755:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775168:0@lo:503: 00000004:00080000:1.0:1788836406.625256:0:8486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788836406.625326:0:8486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 190531313635ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788836406.625333:0:8486:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788836406.625384:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782775296:0@lo:700: 00000100:00100000:1.0:1788836406.625482:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836406.625503:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.625578:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775296 00000100:00100000:0.0:1788836406.625585:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775296 00000100:00100000:0.0:1788836406.625643:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836406.625661:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8487:x1875730782775296:12345-0@lo:700: 00000100:00100000:0.0:1788836406.625710:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8414:1875730782775424:0@lo:700: 00000100:00100000:0.0:1788836406.625741:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.625761:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.625856:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775424 00000100:00100000:0.0:1788836406.625860:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775424 00000100:00100000:0.0:1788836406.625885:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836406.625891:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8414:x1875730782775424:12345-0@lo:700: 00000100:00080000:1.0:1788836406.627677:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836406.629682:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.629735:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775168 00000100:00100000:2.0:1788836406.629744:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775168 00000100:00100000:2.0:1788836406.629787:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788836406.629796:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782775168:12345-0@lo:503: 00000100:00100000:2.0:1788836406.629910:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782775168:12345-0@lo:503: Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.629918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788836406.629968:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.629990:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775168:0@lo:503: 00000100:00100000:2.0:1788836406.634683:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8490:1875730782775552:0@lo:502: 00000100:00100000:2.0:1788836406.634767:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.634803:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775552 00000100:00100000:2.0:1788836406.634810:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775552 00000100:00100000:2.0:1788836406.634853:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788836406.634862:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8490:x1875730782775552:12345-0@lo:502: 00000100:00100000:2.0:1788836406.635037:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8490:x1875730782775552:12345-0@lo:502: Request processed in 175us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.635051:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 40000000:02000000:0.0:1788836406.638329:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788836406.639510:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.639552:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8490:1875730782775552:0@lo:502: 00000100:00100000:2.0:1788836406.639631:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8490:1875730782775680:0@lo:502: 00000100:00100000:2.0:1788836406.639708:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.639744:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775680 00000100:00100000:2.0:1788836406.639751:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775680 00000100:00100000:2.0:1788836406.640908:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788836406.640922:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8490:x1875730782775680:12345-0@lo:502: 00000100:00100000:2.0:1788836406.641084:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:8490:x1875730782775680:12345-0@lo:502: Request processed in 165us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.644560:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:2.0:1788836406.644720:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788836406.645957:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.646001:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8490:1875730782775680:0@lo:502: 00000040:00080000:2.0:1788836406.646068:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1788836406.646623:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8414:x1875730782775424:12345-0@lo:700: Request processed in 20729us (20878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.646634:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836406.646697:0:8414:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736a300 x1875730782775424/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.646711:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8414:1875730782775424:0@lo:700: 40000000:02000000:0.0:1788836406.646722:0:8414:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:01000000:2.0:1788836406.646900:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788836406.646920:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836406.646931:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.646940:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836406.646950:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836406.646952:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf50b59800 from 5 10000000:01000000:2.0:1788836406.646955:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836406.647003:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.647029:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.647038:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.647056:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775808:0@lo:101: 00000100:00100000:2.0:1788836406.647277:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.647300:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.647320:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775808 00000100:00100000:2.0:1788836406.647326:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775808 00000100:00100000:2.0:1788836406.647363:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788836406.647371:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782775808:12345-0@lo:101: 00010000:00010000:2.0:1788836406.647383:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836406.647395:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553df0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.647419:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.649032:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.649044:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46000, rc 0) 00000100:00100000:2.0:1788836406.650514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782775808:12345-0@lo:101: Request processed in 3135us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.650527:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788836406.650614:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775808:0@lo:101: 00010000:00010000:2.0:1788836406.650638:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.650651:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.650729:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775936:0@lo:256: 00000100:00100000:2.0:1788836406.650902:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.650937:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.650955:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782775936 00000100:00100000:2.0:1788836406.650962:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782775936 00000100:00100000:2.0:1788836406.651000:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788836406.651032:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782775936:12345-0@lo:256: 20000000:01000000:2.0:1788836406.651054:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836406.651070:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836406.651073:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788836406.652378:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782775936:12345-0@lo:256: Request processed in 1364us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.652389:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788836406.652444:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782775936:0@lo:256: 10000000:01000000:2.0:1788836406.652499:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836406.652508:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.652519:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836406.652540:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788836406.652543:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788836406.652546:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836406.652576:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.652584:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.652593:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.652608:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776064:0@lo:101: 00000100:00100000:2.0:1788836406.652638:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.653853:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.653879:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776064 00000100:00100000:2.0:1788836406.653886:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776064 00000100:00100000:2.0:1788836406.653930:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788836406.653937:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782776064:12345-0@lo:101: 00010000:00010000:2.0:1788836406.653951:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836406.653968:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553dfe expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.653993:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.654004:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.654039:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47400, rc 0) 00000100:00100000:2.0:1788836406.654086:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782776064:12345-0@lo:101: Request processed in 150us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.655320:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788836406.655388:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776064:0@lo:101: 00010000:00010000:2.0:1788836406.655408:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.655421:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.655506:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776192:0@lo:501: 00000100:00100000:2.0:1788836406.655551:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.655585:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.655600:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776192 00000100:00100000:2.0:1788836406.655605:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776192 00000100:00100000:2.0:1788836406.655633:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788836406.655639:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782776192:12345-0@lo:501: 00000100:00100000:2.0:1788836406.655759:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782776192:12345-0@lo:501: Request processed in 120us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.655765:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788836406.655802:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776192:0@lo:501: 00000100:00100000:2.0:1788836406.655825:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776320:0@lo:503: 00000100:00100000:2.0:1788836406.655864:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.655875:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.655891:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776320 00000100:00100000:2.0:1788836406.655894:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776320 00000100:00100000:2.0:1788836406.655911:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788836406.655916:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782776320:12345-0@lo:503: 00000100:00100000:2.0:1788836406.655988:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782776320:12345-0@lo:503: Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.655993:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788836406.656045:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782776320:0@lo:503: 00010000:00010000:0.0:1788836406.664507:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836406.671867:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8491:1875730782776448:0@lo:502: 00000100:00100000:0.0:1788836406.671956:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.672003:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.672320:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776448 00000100:00100000:2.0:1788836406.672327:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776448 00000100:00100000:2.0:1788836406.672370:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788836406.672379:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:8491:x1875730782776448:12345-0@lo:502: 00000100:00100000:2.0:1788836406.672513:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:8491:x1875730782776448:12345-0@lo:502: Request processed in 134us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.672522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788836406.672737:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8491:1875730782776448:0@lo:502: 00000020:01000000:0.0:1788836406.672765:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836406.672785:0:8491:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788836406.672793:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836406.672795:0:8491:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788836406.672805:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836406.672809:0:8491:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:0.0:1788836406.672828:0:8491:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788836406.672831:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836406.672854:0:8491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8adf7fb83370) 00000020:00000080:0.0:1788836406.672874:0:8491:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788836406.672879:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836406.672956:0:8491:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788836406.672962:0:8491:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788836406.672969:0:8491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553e13 00010000:00080000:0.0:1788836406.673002:0:8491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf46eab000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836406.675890:0:8491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1788836406.680733:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788836406.681073:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782775296:12345-0@lo:700: Request processed in 55408us (55586us total) trans 0 rc 0/0 00010000:00080000:3.0:1788836406.681255:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463daa00 x1875730782775296/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836406.681270:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782775296:0@lo:700: 00000100:00100000:1.0:1788836406.681467:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788836406.704799:0:8491:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788836406.704826:0:8491:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788836406.705077:0:8491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836406.705532:0:8491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836406.705625:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788836406.705861:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1788836406.709973:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782776576:0@lo:13: 00000100:00100000:0.0:1788836406.710066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.710258:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776576 00000100:00100000:0.0:1788836406.710267:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776576 00000100:00100000:0.0:1788836406.710309:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836406.710319:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782776576:12345-0@lo:13: 00002000:00000024:0.0:1788836406.710359:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1788836406.710404:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782776576:12345-0@lo:13: Request processed in 86us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.710411:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788836406.710458:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736a300 x1875730782776576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.710488:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782776576:0@lo:13: 00000004:00080000:0.0:1788836406.710509:0:8487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788836406.710529:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782776704:0@lo:7: 00000100:00100000:0.0:1788836406.710570:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.710586:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf587ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.711178:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776704 00000100:00100000:2.0:1788836406.711184:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776704 00000100:00100000:2.0:1788836406.711221:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836406.711229:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782776704:12345-0@lo:7: 00002000:00080000:2.0:1788836406.719997:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00000040:00080000:0.0:1788836406.720320:0:8494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836406.720326:0:8494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00002000:00080000:2.0:1788836406.720384:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788836406.720525:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782776704:12345-0@lo:7: Request processed in 9290us (9946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.720546:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1788836406.723186:0:8491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836406.723201:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836406.723242:0:8491:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788836406.723265:0:8491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553e1a 00000100:00080000:2.0:1788836406.723281:0:8491:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836406.723285:0:8491:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adf46eab000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836406.723317:0:8491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade41ebe300 x1875730782776832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836406.723337:0:8491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788836406.723402:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836406.723406:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.723407:0:8491:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788836406.723410:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836406.723414:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.723415:0:8491:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836406.723418:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836406.723420:0:8491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788836406.723448:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8491:1875730782776960:0@lo:502: 00000100:00100000:2.0:1788836406.723518:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.723564:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.723585:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776960 00000100:00100000:2.0:1788836406.723591:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776960 00000100:00100000:2.0:1788836406.723626:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788836406.723635:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:8491:x1875730782776960:12345-0@lo:502: 00000100:00100000:2.0:1788836406.723764:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:8491:x1875730782776960:12345-0@lo:502: Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.724613:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788836406.724749:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:8491:1875730782776960:0@lo:502: 00000020:01000000:2.0:1788836406.726184:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836406.726195:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836406.726198:0:8491:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788836406.726204:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788836406.726334:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788836406.726364:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788836406.726375:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.726385:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836406.726394:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788836406.726396:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adf48a1cd28 from 1 10000000:01000000:2.0:1788836406.726399:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788836406.726429:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.726438:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.726448:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.726468:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782777088:0@lo:101: 00000100:00100000:2.0:1788836406.726524:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.728199:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be000 going to sleep for 11 seconds 00010000:00080000:0.0:1788836406.730748:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736a300 x1875730782776704/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.730771:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782776704:0@lo:7: 00000004:00080000:0.0:1788836406.732195:0:8487:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788836406.732229:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777088 00000100:00100000:0.0:1788836406.732238:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777088 00000100:00100000:0.0:1788836406.732286:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788836406.732296:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782777088:12345-0@lo:101: 00010000:00010000:0.0:1788836406.732311:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836406.732329:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553e21 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.732356:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.732368:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836406.732377:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:0.0:1788836406.732456:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782777088:12345-0@lo:101: Request processed in 161us (5931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.732463:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788836406.733752:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782777088:0@lo:101: 00010000:00010000:2.0:1788836406.733840:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.733854:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836406.733937:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782777216:0@lo:501: 00000100:00100000:2.0:1788836406.733995:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836406.734050:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836406.734069:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777216 00000100:00100000:2.0:1788836406.734074:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777216 00000100:00100000:2.0:1788836406.735208:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788836406.735220:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782777216:12345-0@lo:501: 00000100:00100000:2.0:1788836406.735337:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782777216:12345-0@lo:501: Request processed in 120us (1341us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836406.735345:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788836406.735398:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782777216:0@lo:501: 10000000:01000000:2.0:1788836406.735431:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788836406.735440:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836406.735450:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836406.736244:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782776832:0@lo:8: 00000100:00100000:0.0:1788836406.736299:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.736515:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782777344:0@lo:5: 00000100:00100000:2.0:1788836406.737753:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782776832 00000100:00100000:2.0:1788836406.737766:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782776832 00000100:00100000:2.0:1788836406.737889:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836406.737898:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782776832:12345-0@lo:8: 00010000:00080000:2.0:1788836406.737930:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788836406.737959:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553e2f 00002000:00100000:2.0:1788836406.737977:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ade4252f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788836406.737981:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788836406.737984:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788836406.738085:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788836406.738238:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.738278:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788836406.738286:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788836406.738397:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836406.738638:0:8407:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836406.738648:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777344 00000100:00100000:3.0:1788836406.738652:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777344 00000100:00080000:2.0:1788836406.739196:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ade4252b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836406.739269:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782776832:12345-0@lo:8: Request processed in 1369us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.739276:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836406.739295:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836406.739303:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782777344:12345-0@lo:5: 00002000:00080000:2.0:1788836406.739329:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788836406.739356:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782777344:12345-0@lo:5: Request processed in 55us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.739361:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788836406.739918:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebe300 x1875730782776832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.739931:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836406.739939:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788836406.739948:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836406.739954:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788836406.739957:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf46eab000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836406.739976:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836406.739982:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782776832:0@lo:8: 00010000:00080000:0.0:1788836406.740041:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77368e00 x1875730782777344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.740051:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782777344:0@lo:5: 00000004:00080000:0.0:1788836406.740062:0:8487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788836406.740601:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782777472:0@lo:5: 00000100:00100000:0.0:1788836406.740646:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.748845:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777472 00000100:00100000:3.0:1788836406.748865:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777472 00000100:00100000:3.0:1788836406.748934:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836406.748944:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8487:x1875730782777472:12345-0@lo:5: 00002000:00080000:3.0:1788836406.748996:0:8498:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:2.0:1788836406.750519:0:8495:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000004:00080000:1.0:1788836406.750739:0:8494:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788836406.751218:0:8494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190657204883ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788836406.751225:0:8494:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788836406.752237:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836406.752259:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782777600:0@lo:13: 00000100:00100000:0.0:1788836406.752329:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.752371:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777600 00000100:00100000:0.0:1788836406.752378:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777600 00000100:00100000:0.0:1788836406.752428:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836406.752435:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782777600:12345-0@lo:13: 00002000:00000024:0.0:1788836406.752459:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:0.0:1788836406.752498:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782777600:12345-0@lo:13: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.752505:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788836406.752523:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836406.752910:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782777728:0@lo:7: 00000100:00100000:2.0:1788836406.752952:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.755454:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8487:x1875730782777472:12345-0@lo:5: Request processed in 6505us (14802us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788836406.755465:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836406.756223:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be000 going to sleep for 11 seconds 00000004:00080000:1.0:1788836406.756744:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1788836406.760150:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebc380 x1875730782777600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.760178:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782777600:0@lo:13: 00000100:00100000:3.0:1788836406.760329:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777728 00000100:00100000:3.0:1788836406.760337:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777728 00000100:00100000:3.0:1788836406.760387:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836406.760395:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8495:x1875730782777728:12345-0@lo:7: 00000100:00100000:0.0:1788836406.766804:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0840 going to sleep for 11 seconds 00010000:00080000:0.0:1788836406.766852:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77368e00 x1875730782777472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.766869:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8487:1875730782777472:0@lo:5: 00000004:00080000:0.0:1788836406.766885:0:8487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788836406.766932:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8487:1875730782777856:0@lo:900: 00000100:00100000:0.0:1788836406.766994:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.767066:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777856 00000100:00100000:0.0:1788836406.767073:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777856 00000100:00100000:0.0:1788836406.767130:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836406.767138:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8487:x1875730782777856:12345-0@lo:900: 00000100:00100000:0.0:1788836406.767195:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8487:x1875730782777856:12345-0@lo:900: Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836406.767203:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836406.767225:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0840 going to sleep for 11 seconds 00010000:00080000:0.0:1788836406.767237:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736b800 x1875730782777856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.767246:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8487:1875730782777856:0@lo:900: 00002000:00080000:3.0:1788836406.780059:0:8498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788836406.780072:0:8498:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788836406.780230:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8495:x1875730782777728:12345-0@lo:7: Request processed in 19831us (27273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.780242:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788836406.780343:0:8495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebca80 x1875730782777728/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.780357:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782777728:0@lo:7: 00000004:00080000:0.0:1788836406.780374:0:8495:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788836406.780414:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782777984:0@lo:5: 00000100:00100000:0.0:1788836406.780451:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.780489:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836406.781896:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782777984 00000100:00100000:3.0:1788836406.781906:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782777984 00000100:00100000:3.0:1788836406.781966:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836406.781976:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8495:x1875730782777984:12345-0@lo:5: 00002000:00080000:3.0:1788836406.782008:0:8407:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788836406.782028:0:8407:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788836406.816838:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788836406.816857:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788836406.816862:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788836406.816998:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8495:x1875730782777984:12345-0@lo:5: Request processed in 35019us (36541us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788836406.817033:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788836406.821251:0:8495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444fe300 x1875730782777984/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836406.821266:0:8495:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788836406.821273:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782777984:0@lo:5: 00000004:00080000:3.0:1788836406.821291:0:8495:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788836406.821342:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782778112:0@lo:700: 00000100:00100000:3.0:1788836406.821401:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.821456:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836406.822352:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778112 00000100:00100000:0.0:1788836406.822365:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778112 00000100:00100000:0.0:1788836406.822431:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836406.822441:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8495:x1875730782778112:12345-0@lo:700: 00000100:00100000:3.0:1788836406.840507:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8495:x1875730782778112:12345-0@lo:700: Request processed in 18058us (19095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.840526:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836406.840583:0:8495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8380 x1875730782778112/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836406.840597:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782778112:0@lo:700: 00000004:02000040:3.0:1788836406.843764:0:8495:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788836406.853791:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782778240:0@lo:5: 00000100:00100000:3.0:1788836406.853873:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836406.853918:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778240 00000100:00100000:3.0:1788836406.853925:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778240 00000100:00100000:3.0:1788836406.853976:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836406.853985:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8495:x1875730782778240:12345-0@lo:5: 00000100:00100000:2.0:1788836406.860858:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56c00 going to sleep for 11 seconds 00002000:00080000:2.0:1788836406.869428:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788836406.869762:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788836406.878171:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8495:x1875730782778240:12345-0@lo:5: Request processed in 24179us (24301us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788836406.878186:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788836406.883761:0:8495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8380 x1875730782778240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836406.883845:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8495:1875730782778240:0@lo:5: 00000004:00080000:3.0:1788836406.883862:0:8495:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788836407.681307:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836408.064609:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836408.064635:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782778368:0@lo:41: 00000100:00100000:2.0:1788836408.064712:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836408.064773:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778368 00000100:00100000:2.0:1788836408.064780:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778368 00000100:00100000:2.0:1788836408.064827:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836408.064837:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782778368:12345-0@lo:41: 00000004:00000024:2.0:1788836408.064872:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788836408.064916:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782778368:12345-0@lo:41: Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836408.064939:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836408.064988:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782778368:0@lo:41: 00010000:00010000:0.0:1788836408.709314:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836409.735668:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836410.753382:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836411.134353:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836411.134378:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782778496:0@lo:41: 00000100:00100000:3.0:1788836411.134453:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836411.134647:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778496 00000100:00100000:2.0:1788836411.134655:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778496 00000100:00100000:2.0:1788836411.134714:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836411.134724:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782778496:12345-0@lo:41: 00000004:00000024:2.0:1788836411.134755:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788836411.134802:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782778496:12345-0@lo:41: Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836411.134809:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836411.135064:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782778496:0@lo:41: 00010000:00010000:3.0:1788836411.775474:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788836412.064258:0:8782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788836412.158374:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782778624:0@lo:13: 00000100:00100000:0.0:1788836412.158446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836412.158525:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778624 00000100:00100000:0.0:1788836412.158533:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778624 00000100:00100000:0.0:1788836412.158592:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836412.158601:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782778624:12345-0@lo:13: 00002000:00000024:0.0:1788836412.158627:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836412.158666:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782778624:12345-0@lo:13: Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836412.158672:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788836412.158692:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836412.158718:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444fce00 x1875730782778624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836412.158728:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788836412.158746:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782778624:0@lo:13: 00000100:00100000:3.0:1788836412.161190:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782778880:0@lo:400: 00000100:00100000:3.0:1788836412.161253:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161290:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782779392:0@lo:400: 00000100:00100000:3.0:1788836412.161319:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161344:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788836412.161350:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782779008:0@lo:400: 00000100:00100000:3.0:1788836412.161373:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161389:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782779520:0@lo:400: 00000100:00100000:3.0:1788836412.161412:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161441:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778880 00000100:00100000:3.0:1788836412.161454:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778880 00000100:00100000:3.0:1788836412.161510:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788836412.161518:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3614:x1875730782778880:12345-0@lo:400: 00000100:00100000:3.0:1788836412.161563:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3614:x1875730782778880:12345-0@lo:400: Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.161580:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788836412.161614:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779392 00000100:00100000:3.0:1788836412.161618:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779392 00000100:00100000:3.0:1788836412.161643:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836412.161649:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782779392:12345-0@lo:400: 00000100:00100000:3.0:1788836412.161681:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782779392:12345-0@lo:400: Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.161686:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836412.161702:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779008 00000100:00100000:3.0:1788836412.161706:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779008 00000100:00100000:3.0:1788836412.161724:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779520 00000100:00100000:3.0:1788836412.161727:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779520 00000100:00100000:3.0:1788836412.161746:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836412.161751:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782779008:12345-0@lo:400: 00000100:00100000:3.0:1788836412.161779:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782779008:12345-0@lo:400: Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.161785:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836412.161796:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836412.161802:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782779520:12345-0@lo:400: 00000100:00100000:3.0:1788836412.161828:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782779520:12345-0@lo:400: Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.161833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836412.161865:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782779136:0@lo:400: 00000100:00100000:3.0:1788836412.161892:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161910:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782779648:0@lo:400: 00000100:00100000:3.0:1788836412.161932:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161948:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836412.161953:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782778752:0@lo:13: 00000100:00100000:3.0:1788836412.161976:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.161992:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782779264:0@lo:400: 00000100:00100000:3.0:1788836412.162031:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.162044:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782779776:0@lo:400: 00000100:00100000:3.0:1788836412.162065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836412.162088:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779136 00000100:00100000:3.0:1788836412.162091:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779136 00000100:00100000:3.0:1788836412.162114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836412.162119:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782779136:12345-0@lo:400: 00000100:00100000:3.0:1788836412.162153:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782779136:12345-0@lo:400: Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.162159:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836412.162175:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779648 00000100:00100000:3.0:1788836412.162179:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779648 00000100:00100000:3.0:1788836412.162192:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779264 00000100:00100000:3.0:1788836412.162195:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779264 00000100:00100000:3.0:1788836412.162207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788836412.162212:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782779648:12345-0@lo:400: 00000100:00100000:3.0:1788836412.162237:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782779648:12345-0@lo:400: Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.162243:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788836412.162263:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836412.162267:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782779264:12345-0@lo:400: 00000100:00100000:3.0:1788836412.162293:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782779264:12345-0@lo:400: Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.162297:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788836412.162330:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f9500 x1875730782779008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836412.162344:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782779008:0@lo:400: 00010000:00080000:3.0:1788836412.162354:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817b8700 x1875730782779520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836412.162363:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782779520:0@lo:400: 00000100:00100000:3.0:1788836412.162371:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782778880:0@lo:400: 00000100:00100000:3.0:1788836412.162380:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782779392:0@lo:400: 00010000:00080000:3.0:1788836412.162417:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817baa00 x1875730782779264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836412.162426:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782779264:0@lo:400: 00000100:00100000:3.0:1788836412.162434:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782779136:0@lo:400: 00010000:00080000:3.0:1788836412.162442:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817ba680 x1875730782779648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836412.162448:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782779648:0@lo:400: 00000100:00080000:0.0:1788836412.166181:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836412.166190:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836412.166209:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782778752 00000100:00100000:0.0:1788836412.166220:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782778752 00000100:00100000:0.0:1788836412.166287:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836412.166296:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782778752:12345-0@lo:13: 00002000:00000024:0.0:1788836412.166322:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836412.166403:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782778752:12345-0@lo:13: Request processed in 107us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836412.166411:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836412.166487:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779776 00000100:00100000:2.0:1788836412.166491:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779776 00000100:00100000:2.0:1788836412.166523:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836412.166531:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3616:x1875730782779776:12345-0@lo:400: 00000100:00100000:2.0:1788836412.166567:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3616:x1875730782779776:12345-0@lo:400: Request processed in 37us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836412.166583:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788836412.168179:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8e00 x1875730782778752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836412.168220:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782778752:0@lo:13: 00010000:00080000:0.0:1788836412.168236:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817b9880 x1875730782779776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836412.168245:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782779776:0@lo:400: 00000100:00080000:0.0:1788836412.168284:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788836412.799383:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788836413.089328:0:8834:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836413.089506:0:8834:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1788836413.189566:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788836413.191115:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836413.191144:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782779904:0@lo:41: 00000100:00100000:3.0:1788836413.191207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836413.191261:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782779904 00000100:00100000:3.0:1788836413.191267:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782779904 00000100:00100000:3.0:1788836413.191306:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836413.191313:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782779904:12345-0@lo:41: 00000004:00000024:3.0:1788836413.191342:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788836413.191377:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782779904:12345-0@lo:41: Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836413.191384:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836413.191421:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782779904:0@lo:41: 00010000:00010000:3.0:1788836413.822385:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836414.850160:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836415.870995:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836415.925913:0:8936:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836415.927589:0:8936:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788836416.254680:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836416.254707:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782780032:0@lo:41: 00000100:00100000:2.0:1788836416.254777:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.255097:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780032 00000100:00100000:1.0:1788836416.255106:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780032 00000100:00100000:1.0:1788836416.255164:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836416.255174:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782780032:12345-0@lo:41: 00000004:00000024:1.0:1788836416.255216:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788836416.255264:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782780032:12345-0@lo:41: Request processed in 91us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836416.255271:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836416.255362:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782780032:0@lo:41: 00010000:00010000:0.0:1788836416.895113:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836417.038970:0:8984:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836417.038989:0:8984:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788836417.284353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782780160:0@lo:13: 00000100:00100000:0.0:1788836417.284586:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836417.284773:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836417.284781:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782780288:0@lo:13: 00000100:00100000:0.0:1788836417.284806:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836417.285074:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782780416:0@lo:400: 00000100:00100000:2.0:1788836417.285113:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836417.285151:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782780928:0@lo:400: 00000100:00100000:2.0:1788836417.285178:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836417.285199:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836417.285204:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782780544:0@lo:400: 00000100:00100000:2.0:1788836417.285230:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836417.285247:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782781056:0@lo:400: 00000100:00100000:2.0:1788836417.285268:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836417.285300:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780416 00000100:00100000:2.0:1788836417.285309:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780416 00000100:00100000:2.0:1788836417.285366:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788836417.285376:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3614:x1875730782780416:12345-0@lo:400: 00000100:00100000:2.0:1788836417.285437:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3614:x1875730782780416:12345-0@lo:400: Request processed in 61us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836417.285444:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836417.289892:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782780800:0@lo:400: 00000100:00100000:1.0:1788836417.290005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836417.290085:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782781312:0@lo:400: 00000100:00100000:1.0:1788836417.290146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836417.290184:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836417.290191:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782780672:0@lo:400: 00000100:00100000:1.0:1788836417.290216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836417.290233:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782781184:0@lo:400: 00000100:00100000:1.0:1788836417.290253:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836417.290285:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780928 00000100:00100000:1.0:1788836417.290296:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780928 00000100:00100000:1.0:1788836417.290351:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780672 00000100:00100000:1.0:1788836417.290354:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780672 00000100:00100000:1.0:1788836417.290371:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836417.290382:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782780928:12345-0@lo:400: 00000100:00100000:1.0:1788836417.290462:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782780928:12345-0@lo:400: Request processed in 68us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.290470:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836417.290519:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836417.290527:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782780672:12345-0@lo:400: 00000100:00100000:1.0:1788836417.290560:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782780672:12345-0@lo:400: Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.290577:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836417.290740:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781312 00000100:00100000:2.0:1788836417.290744:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781312 00000100:00100000:2.0:1788836417.290788:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836417.290795:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782781312:12345-0@lo:400: 00000100:00100000:2.0:1788836417.290830:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782781312:12345-0@lo:400: Request processed in 37us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836417.290836:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836417.290881:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782780416:0@lo:400: 00000100:00100000:2.0:1788836417.290896:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782780928:0@lo:400: 00000100:00100000:1.0:1788836417.291854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782780672:0@lo:400: 00010000:00080000:1.0:1788836417.291875:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebd500 x1875730782781312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836417.291885:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788836417.291900:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782781312:0@lo:400: 00000100:00100000:1.0:1788836417.292071:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780544 00000100:00100000:1.0:1788836417.292078:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780544 00000100:00100000:1.0:1788836417.292112:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781056 00000100:00100000:1.0:1788836417.292115:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781056 00000100:00100000:1.0:1788836417.292132:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780800 00000100:00100000:1.0:1788836417.292135:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780800 00000100:00100000:1.0:1788836417.292145:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781184 00000100:00100000:1.0:1788836417.292148:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781184 00000100:00100000:1.0:1788836417.292163:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836417.292171:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782780544:12345-0@lo:400: 00000100:00100000:1.0:1788836417.292242:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782780544:12345-0@lo:400: Request processed in 72us (7011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.292251:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836417.292265:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836417.292270:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782781056:12345-0@lo:400: 00000100:00100000:1.0:1788836417.292298:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782781056:12345-0@lo:400: Request processed in 29us (7029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.292304:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836417.292314:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836417.292319:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782780800:12345-0@lo:400: 00000100:00100000:1.0:1788836417.292361:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782780800:12345-0@lo:400: Request processed in 41us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.292367:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836417.292379:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836417.292385:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782781184:12345-0@lo:400: 00000100:00100000:1.0:1788836417.292414:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782781184:12345-0@lo:400: Request processed in 29us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.292419:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788836417.292456:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebca80 x1875730782780544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836417.292468:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782780544:0@lo:400: 00010000:00080000:1.0:1788836417.292490:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebdf80 x1875730782781056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836417.292500:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782781056:0@lo:400: 00010000:00080000:1.0:1788836417.292530:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebd880 x1875730782781184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836417.292540:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782781184:0@lo:400: 00010000:00080000:1.0:1788836417.292551:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebe300 x1875730782780800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836417.292559:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782780800:0@lo:400: 00000100:00080000:0.0:1788836417.299521:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836417.299537:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836417.299543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836417.303556:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780160 00000100:00100000:3.0:1788836417.303580:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780160 00000100:00100000:3.0:1788836417.305385:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782780288 00000100:00100000:3.0:1788836417.305401:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782780288 00000100:00100000:3.0:1788836417.305427:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836417.305439:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782780160:12345-0@lo:13: 00002000:00000024:3.0:1788836417.307004:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836417.307144:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782780160:12345-0@lo:13: Request processed in 1704us (22555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836417.307157:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836417.307196:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836417.307207:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782780288:12345-0@lo:13: 00002000:00000024:3.0:1788836417.307220:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836417.307247:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782780288:12345-0@lo:13: Request processed in 43us (22439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836417.307264:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788836417.311590:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836417.311685:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817ba680 x1875730782780288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836417.311717:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782780288:0@lo:13: 00010000:00080000:0.0:1788836417.311735:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444fce00 x1875730782780160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836417.311747:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782780160:0@lo:13: 00010000:00010000:1.0:1788836417.923903:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836418.305962:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782781440:0@lo:41: 00000100:00100000:1.0:1788836418.306098:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836418.307271:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781440 00000100:00100000:2.0:1788836418.307287:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781440 00000100:00100000:2.0:1788836418.307373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836418.307386:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782781440:12345-0@lo:41: 00000004:00000024:2.0:1788836418.307452:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788836418.307562:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782781440:12345-0@lo:41: Request processed in 178us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836418.307794:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782781440:0@lo:41: 00000100:00100000:2.0:1788836418.307897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788836418.942166:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836419.966390:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836420.990471:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836421.374323:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782781568:0@lo:41: 00000100:00100000:0.0:1788836421.374442:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.374645:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781568 00000100:00100000:3.0:1788836421.374656:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781568 00000100:00100000:3.0:1788836421.374729:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836421.374741:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782781568:12345-0@lo:41: 00000004:00000024:3.0:1788836421.374787:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788836421.374844:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782781568:12345-0@lo:41: Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.374851:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836421.374940:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782781568:0@lo:41: 00010000:00010000:1.0:1788836422.016101:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836422.399271:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782781824:0@lo:400: 00000100:00100000:1.0:1788836422.399344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782782336:0@lo:400: 00000100:00100000:1.0:1788836422.399423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399464:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836422.399470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782781696:0@lo:400: 00000100:00100000:1.0:1788836422.399499:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399527:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782782208:0@lo:400: 00000100:00100000:1.0:1788836422.399550:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399567:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782782720:0@lo:400: 00000100:00100000:1.0:1788836422.399588:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399615:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782782080:0@lo:400: 00000100:00100000:1.0:1788836422.399637:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399655:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782782592:0@lo:400: 00000100:00100000:1.0:1788836422.399695:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399715:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788836422.399721:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782781952:0@lo:400: 00000100:00100000:1.0:1788836422.399742:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399761:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782782464:0@lo:400: 00000100:00100000:1.0:1788836422.399782:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836422.399805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781824 00000100:00100000:1.0:1788836422.399812:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781824 00000100:00100000:3.0:1788836422.399889:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781696 00000100:00100000:3.0:1788836422.399894:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781696 00000100:00100000:3.0:1788836422.399931:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788836422.399939:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782781696:12345-0@lo:400: 00000100:00100000:3.0:1788836422.399992:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782781696:12345-0@lo:400: Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836422.399999:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788836422.400307:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782720 00000100:00100000:2.0:1788836422.400312:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782720 00000100:00100000:2.0:1788836422.400349:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782592 00000100:00100000:2.0:1788836422.400352:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782592 00000100:00100000:2.0:1788836422.400376:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836422.400384:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782782720:12345-0@lo:400: 00000100:00100000:2.0:1788836422.400434:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782782720:12345-0@lo:400: Request processed in 51us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836422.400450:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836422.400463:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836422.400470:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782782592:12345-0@lo:400: 00000100:00100000:2.0:1788836422.400512:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782782592:12345-0@lo:400: Request processed in 42us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836422.400518:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788836422.400544:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836422.400955:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782336 00000100:00100000:1.0:1788836422.400962:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782336 00000100:00100000:1.0:1788836422.400981:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782080 00000100:00100000:1.0:1788836422.400994:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782080 00000100:00100000:1.0:1788836422.401009:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782464 00000100:00100000:1.0:1788836422.401028:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782464 00000100:00100000:1.0:1788836422.401047:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836422.401054:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782781824:12345-0@lo:400: 00000100:00100000:1.0:1788836422.401092:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782781824:12345-0@lo:400: Request processed in 40us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401097:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836422.401111:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836422.401117:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782782336:12345-0@lo:400: 00000100:00100000:1.0:1788836422.401202:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782782336:12345-0@lo:400: Request processed in 84us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401208:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836422.401221:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836422.401227:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782782080:12345-0@lo:400: 00000100:00100000:1.0:1788836422.401254:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782782080:12345-0@lo:400: Request processed in 27us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401261:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836422.401272:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836422.401278:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782782464:12345-0@lo:400: 00000100:00100000:1.0:1788836422.401305:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782782464:12345-0@lo:400: Request processed in 28us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836422.401333:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782208 00000100:00100000:1.0:1788836422.401337:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782208 00000100:00100000:1.0:1788836422.401359:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782781952 00000100:00100000:1.0:1788836422.401362:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782781952 00000100:00100000:1.0:1788836422.401384:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836422.401390:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782782208:12345-0@lo:400: 00000100:00100000:1.0:1788836422.401434:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782782208:12345-0@lo:400: Request processed in 45us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401913:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836422.401930:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836422.401938:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782781952:12345-0@lo:400: 00010000:00080000:3.0:1788836422.401969:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7aed80 x1875730782782464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.401969:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782781952:12345-0@lo:400: Request processed in 34us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.401975:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836422.401983:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782782464:0@lo:400: 00010000:00080000:3.0:1788836422.401996:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7ac000 x1875730782782080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836422.402004:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782782080:0@lo:400: 00000100:00100000:1.0:1788836422.402031:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782781696:0@lo:400: 00010000:00080000:3.0:1788836422.402036:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7ac700 x1875730782782592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.402042:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782782208:0@lo:400: 00010000:00080000:1.0:1788836422.402054:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7ae680 x1875730782782720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.402063:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782782720:0@lo:400: 00010000:00080000:1.0:1788836422.402074:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7ad180 x1875730782781824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.402082:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782781824:0@lo:400: 00010000:00080000:1.0:1788836422.402093:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7aea00 x1875730782782336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.402100:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782782336:0@lo:400: 00000100:00080000:2.0:1788836422.402310:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836422.402314:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836422.402367:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782782592:0@lo:400: 00000100:00100000:3.0:1788836422.402412:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782781952:0@lo:400: 00000100:00100000:0.0:1788836422.402930:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836422.402944:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782782848:0@lo:13: 00000100:00100000:0.0:1788836422.402988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836422.403199:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782848 00000100:00100000:3.0:1788836422.403205:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782848 00000100:00100000:3.0:1788836422.403247:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836422.403255:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782782848:12345-0@lo:13: 00002000:00000024:3.0:1788836422.403280:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836422.403325:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782782848:12345-0@lo:13: Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836422.404230:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788836422.404283:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf817b8700 x1875730782782848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836422.404301:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782782848:0@lo:13: 00000100:00100000:3.0:1788836422.404322:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836422.404342:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782782976:0@lo:13: 00000100:00100000:3.0:1788836422.404379:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836422.404427:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782782976 00000100:00100000:2.0:1788836422.404433:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782782976 00000100:00100000:2.0:1788836422.404475:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836422.404482:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782782976:12345-0@lo:13: 00002000:00000024:2.0:1788836422.404496:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836422.404545:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782782976:12345-0@lo:13: Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836422.404560:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788836422.404670:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebf100 x1875730782782976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836422.404683:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782782976:0@lo:13: 00010000:00010000:2.0:1788836423.039154:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836423.424405:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782783104:0@lo:41: 00000100:00100000:1.0:1788836423.424482:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836423.424690:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783104 00000100:00100000:2.0:1788836423.424700:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783104 00000100:00100000:2.0:1788836423.424762:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836423.424772:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782783104:12345-0@lo:41: 00000004:00000024:2.0:1788836423.424807:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788836423.432324:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782783104:12345-0@lo:41: Request processed in 7471us (7759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836423.432340:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836423.433170:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782783104:0@lo:41: 00010000:00010000:1.0:1788836424.065259:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836425.091431:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836426.110382:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836426.494362:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782783232:0@lo:41: 00000100:00100000:0.0:1788836426.494438:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836426.494599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783232 00000100:00100000:2.0:1788836426.494607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783232 00000100:00100000:2.0:1788836426.494658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836426.494667:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782783232:12345-0@lo:41: 00000004:00000024:2.0:1788836426.494698:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788836426.494762:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782783232:12345-0@lo:41: Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836426.494768:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836426.495035:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782783232:0@lo:41: 00010000:00010000:1.0:1788836427.134194:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836427.518251:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782783360:0@lo:400: 00000100:00100000:1.0:1788836427.518342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518388:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782783872:0@lo:400: 00000100:00100000:1.0:1788836427.518414:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518433:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782784384:0@lo:400: 00000100:00100000:1.0:1788836427.518464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518490:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836427.518496:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782783744:0@lo:400: 00000100:00100000:1.0:1788836427.518519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518534:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782784256:0@lo:400: 00000100:00100000:1.0:1788836427.518553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518579:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782783488:0@lo:400: 00000100:00100000:1.0:1788836427.518600:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518615:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782784000:0@lo:400: 00000100:00100000:1.0:1788836427.518633:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518648:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836427.518653:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782783616:0@lo:400: 00000100:00100000:1.0:1788836427.518672:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518687:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782784128:0@lo:400: 00000100:00100000:1.0:1788836427.518717:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.518740:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783360 00000100:00100000:1.0:1788836427.518747:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783360 00000100:00100000:1.0:1788836427.518792:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836427.518814:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782783360:12345-0@lo:400: 00000100:00100000:1.0:1788836427.518862:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782783360:12345-0@lo:400: Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.518869:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836427.518902:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783872 00000100:00100000:1.0:1788836427.518905:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783872 00000100:00100000:1.0:1788836427.518927:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783616 00000100:00100000:1.0:1788836427.518930:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783616 00000100:00100000:1.0:1788836427.518942:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836427.518948:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782783872:12345-0@lo:400: 00000100:00100000:1.0:1788836427.518979:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782783872:12345-0@lo:400: Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.518985:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836427.518996:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836427.519002:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782783616:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519055:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782783616:12345-0@lo:400: Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519061:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836427.519077:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784384 00000100:00100000:1.0:1788836427.519081:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784384 00000100:00100000:1.0:1788836427.519110:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784256 00000100:00100000:1.0:1788836427.519113:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784256 00000100:00100000:1.0:1788836427.519130:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836427.519136:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782784384:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519171:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782784384:12345-0@lo:400: Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519178:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836427.519189:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836427.519196:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782784256:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519218:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782784256:12345-0@lo:400: Request processed in 23us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519224:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836427.519240:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783744 00000100:00100000:1.0:1788836427.519243:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783744 00000100:00100000:1.0:1788836427.519259:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782783488 00000100:00100000:1.0:1788836427.519262:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782783488 00000100:00100000:1.0:1788836427.519270:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784000 00000100:00100000:1.0:1788836427.519272:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784000 00000100:00100000:1.0:1788836427.519283:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784128 00000100:00100000:1.0:1788836427.519285:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784128 00000100:00100000:1.0:1788836427.519298:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836427.519315:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782783744:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519344:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782783744:12345-0@lo:400: Request processed in 40us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519350:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836427.519362:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788836427.519368:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782783488:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519391:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782783488:12345-0@lo:400: Request processed in 23us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519396:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788836427.519406:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836427.519411:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782784000:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519446:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782784000:12345-0@lo:400: Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519452:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836427.519463:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836427.519469:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782784128:12345-0@lo:400: 00000100:00100000:1.0:1788836427.519493:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782784128:12345-0@lo:400: Request processed in 24us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.519498:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788836427.519536:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836427.519540:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836427.519542:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836427.519576:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782783616:0@lo:400: 00010000:00080000:1.0:1788836427.519588:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755f80 x1875730782784128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519597:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782784128:0@lo:400: 00010000:00080000:1.0:1788836427.519606:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a756a00 x1875730782783488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519614:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782783488:0@lo:400: 00010000:00080000:1.0:1788836427.519623:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755880 x1875730782784000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519630:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782784000:0@lo:400: 00010000:00080000:1.0:1788836427.519664:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a754700 x1875730782783744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519672:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782783744:0@lo:400: 00010000:00080000:1.0:1788836427.519690:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a757100 x1875730782784256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519698:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782784256:0@lo:400: 00000100:00100000:1.0:1788836427.519707:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782783360:0@lo:400: 00000100:00100000:1.0:1788836427.519716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782783872:0@lo:400: 00010000:00080000:1.0:1788836427.519724:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a756300 x1875730782784384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.519731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782784384:0@lo:400: 00000100:00100000:2.0:1788836427.520207:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836427.520219:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782784512:0@lo:13: 00000100:00100000:2.0:1788836427.520258:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836427.520290:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784512 00000100:00100000:2.0:1788836427.520295:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784512 00000100:00100000:2.0:1788836427.520353:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836427.520361:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782784512:12345-0@lo:13: 00002000:00000024:2.0:1788836427.520383:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836427.520428:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782784512:12345-0@lo:13: Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836427.520721:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788836427.520760:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade41ebf480 x1875730782784512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836427.520777:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782784512:0@lo:13: 00000100:00100000:1.0:1788836427.529659:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836427.529684:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782784640:0@lo:13: 00000100:00100000:1.0:1788836427.529752:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.529800:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784640 00000100:00100000:1.0:1788836427.529807:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784640 00000100:00100000:1.0:1788836427.529857:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836427.529866:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782784640:12345-0@lo:13: 00002000:00000024:1.0:1788836427.529889:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836427.529947:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782784640:12345-0@lo:13: Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.529955:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788836427.529996:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7aed80 x1875730782784640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836427.530037:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782784640:0@lo:13: 00010000:00010000:1.0:1788836428.167069:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836428.554212:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836428.554240:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782784768:0@lo:41: 00000100:00100000:3.0:1788836428.554322:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836428.554389:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784768 00000100:00100000:3.0:1788836428.554396:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784768 00000100:00100000:3.0:1788836428.554444:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836428.554454:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782784768:12345-0@lo:41: 00000004:00000024:3.0:1788836428.554490:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788836428.554533:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782784768:12345-0@lo:41: Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836428.554540:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836428.554604:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782784768:0@lo:41: 00000020:01000004:0.0:1788836429.053310:0:9482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788836429.053314:0:9482:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788836429.053316:0:9482:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788836429.053459:0:9482:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adf7fbb1000 00000020:01000004:0.0:1788836429.053473:0:9482:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788836429.053487:0:9482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788836429.053500:0:9482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8adf7fb819b8) 00000020:00000080:0.0:1788836429.053514:0:9482:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788836429.147430:0:9482:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788836429.147502:0:9482:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1788836429.185388:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:2.0:1788836429.221515:0:9482:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788836429.221692:0:9482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788836429.221714:0:9482:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836429.221724:0:9482:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7b38383a6553e3d 00000020:01000004:2.0:1788836429.221729:0:9482:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788836429.221746:0:9482:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788836429.221748:0:9482:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788836429.221753:0:9482:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788836429.221773:0:9482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788836429.221776:0:9482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788836429.244799:0:9482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788836429.244838:0:9482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788836429.244842:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788836429.244843:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836429.244845:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836429.244846:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836429.244847:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836429.244849:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836429.244855:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836429.244856:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836429.244857:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836429.244859:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836429.244860:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788836429.244864:0:9482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788836429.244866:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836429.244867:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836429.244868:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836429.244869:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836429.244870:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836429.244871:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836429.244872:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836429.244873:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788836429.245353:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788836429.245355:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836429.245356:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788836429.245386:0:9482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788836429.245405:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782784896:0@lo:253: 00000100:00100000:0.0:1788836429.245472:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.245562:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836429.245637:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782784896 00000100:00100000:2.0:1788836429.245647:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782784896 00000100:00100000:2.0:1788836429.245732:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788836429.245742:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:9482:x1875730782784896:12345-0@lo:253: 20000000:01000000:2.0:1788836429.245773:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788836429.245777:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788836429.245782:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788836429.245786:0:6483:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788836429.249471:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836429.249685:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788836429.249702:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788836429.249720:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788836429.249726:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788836429.249739:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788836429.249767:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788836429.249878:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788836429.249895:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836429.249897:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836429.249911:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788836429.249916:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788836429.249930:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788836429.249936:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836429.249948:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788836429.249954:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788836429.249967:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788836429.249981:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788836429.250087:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788836429.250098:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836429.250100:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836429.250112:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788836429.250118:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788836429.250129:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788836429.250134:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836429.250147:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788836429.250153:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788836429.250165:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788836429.250180:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788836429.250544:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788836429.250555:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788836429.250557:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788836429.250570:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788836429.250575:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788836429.250588:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788836429.250593:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788836429.250604:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788836429.250618:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788836429.250632:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788836429.250646:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788836429.250658:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788836429.250661:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788836429.250665:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788836429.250710:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788836429.250713:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788836429.250980:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788836429.250999:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788836429.251043:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788836429.251123:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788836429.251141:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788836429.251154:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788836429.251162:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788836429.251164:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836429.256000:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836429.256213:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836429.256230:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788836429.256446:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788836429.256465:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788836429.256476:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788836429.256485:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788836429.256487:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788836429.257147:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788836429.257293:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788836429.257312:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788836429.257324:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788836429.257334:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788836429.257337:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836429.257630:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836429.257654:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836429.257662:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788836429.257791:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788836429.258187:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788836429.258207:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788836429.258217:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788836429.258219:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836429.258437:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836429.258452:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836429.258463:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788836429.258591:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788836429.258606:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788836429.258617:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1788836429.258631:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788836429.258648:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258665:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258673:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258681:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258688:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258694:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258715:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258722:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258729:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258763:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.258776:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.258789:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785024:0@lo:104: 00000100:00100000:3.0:1788836429.259162:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836429.259234:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.259243:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 21 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.259251:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785152:0@lo:104: 00000100:00100000:3.0:1788836429.259269:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836429.259361:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.259369:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 21 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.259385:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785280:0@lo:104: 00000100:00100000:3.0:1788836429.259411:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.259469:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785024 00000100:00100000:0.0:1788836429.259476:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785024 00000100:00100000:0.0:1788836429.259524:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785152 00000100:00100000:0.0:1788836429.259527:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785152 00000100:00100000:0.0:1788836429.259542:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836429.259551:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785024:12345-0@lo:104: 00010000:00010000:0.0:1788836429.259569:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259622:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836429.259628:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785024:12345-0@lo:104: Request processed in 78us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.259635:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836429.259651:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836429.259657:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782785152:12345-0@lo:104: 00010000:00010000:0.0:1788836429.259663:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259691:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836429.259695:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782785152:12345-0@lo:104: Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.259701:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788836429.259717:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836429.259722:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259729:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836429.259733:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259742:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836429.259747:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.259759:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836429.259801:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259825:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836429.259844:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259852:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6553e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259863:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836429.259867:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259872:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836429.259885:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259893:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836429.259899:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.259905:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836429.259917:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259923:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836429.259944:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259950:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47a00/0xf7b38383a6553dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e05 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.259960:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.259962:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.259963:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.259969:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836429.259980:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782785536:0@lo:103: 00000100:00100000:0.0:1788836429.260008:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836429.260450:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.260459:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 21 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.260467:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785664:0@lo:104: 00000100:00100000:3.0:1788836429.260489:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836429.260574:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.260582:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 21 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.260591:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785792:0@lo:104: 00000100:00100000:3.0:1788836429.260611:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836429.260704:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.260712:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 21 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.260721:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785920:0@lo:104: 00000100:00100000:3.0:1788836429.260745:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.260788:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785280 00000100:00100000:2.0:1788836429.260794:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785280 00000100:00100000:2.0:1788836429.260837:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785664 00000100:00100000:2.0:1788836429.260840:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785664 00000100:00100000:2.0:1788836429.260849:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785792 00000100:00100000:2.0:1788836429.260851:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785792 00000100:00100000:2.0:1788836429.260861:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836429.260869:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6483:x1875730782785280:12345-0@lo:104: 00010000:00010000:2.0:1788836429.260888:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.260951:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836429.260956:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:6483:x1875730782785280:12345-0@lo:104: Request processed in 88us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.260964:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836429.260978:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836429.260984:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785664:12345-0@lo:104: 00010000:00010000:2.0:1788836429.260991:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261044:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836429.261049:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785664:12345-0@lo:104: Request processed in 66us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.261055:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836429.261067:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836429.261073:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782785792:12345-0@lo:104: 00010000:00010000:2.0:1788836429.261080:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261105:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788836429.261110:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782785792:12345-0@lo:104: Request processed in 38us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.261114:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836429.261137:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836429.261146:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782785408:0@lo:103: 00000100:00100000:2.0:1788836429.261172:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.261205:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785536 00000100:00100000:2.0:1788836429.261215:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785536 00010000:00010000:2.0:1788836429.261230:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 22 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.261249:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785408 00000100:00100000:2.0:1788836429.261252:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785408 00010000:00010000:2.0:1788836429.261260:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 23 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.261271:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836429.261287:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:3614:x1875730782785536:12345-0@lo:103: 00010000:00010000:2.0:1788836429.261298:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.261302:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 23 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261311:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 23 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261330:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.261359:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:3614:x1875730782785536:12345-0@lo:103: Request processed in 73us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.261365:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836429.261379:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836429.261384:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3616:x1875730782785408:12345-0@lo:103: 00010000:00010000:2.0:1788836429.261391:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.261395:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 22 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261404:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 22 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261425:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.261451:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3616:x1875730782785408:12345-0@lo:103: Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.261457:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788836429.261476:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836429.261481:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261489:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.261492:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261500:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.261507:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.261512:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.261532:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261538:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.261549:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261554:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553de9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261567:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836429.261575:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261580:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.261583:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261590:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.261596:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.261601:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.261613:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261618:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.261623:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261629:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553dbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261639:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836429.261642:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261648:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.261651:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261668:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.261674:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.261679:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.261691:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261697:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.261702:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261708:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47800/0xf7b38383a6553d9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553da3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.261717:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.261719:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.261720:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.261735:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786048:0@lo:103: 00000100:00100000:2.0:1788836429.261761:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.261790:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782786176:0@lo:103: 00000100:00100000:2.0:1788836429.261812:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.261837:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782785408:0@lo:103: 00000100:00100000:2.0:1788836429.261851:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836429.261856:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782786304:0@lo:103: 00000100:00100000:2.0:1788836429.262169:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.262196:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786048 00000100:00100000:2.0:1788836429.262200:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786048 00010000:00010000:2.0:1788836429.262217:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 22 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.262230:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786176 00000100:00100000:2.0:1788836429.262233:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786176 00010000:00010000:2.0:1788836429.262243:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 23 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.262253:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786304 00000100:00100000:2.0:1788836429.262255:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786304 00010000:00010000:2.0:1788836429.262291:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 24 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.262305:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836429.262312:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782786048:12345-0@lo:103: 00010000:00010000:2.0:1788836429.262321:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.262324:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 24 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262334:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 24 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262346:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.262375:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782786048:12345-0@lo:103: Request processed in 63us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.262380:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836429.262392:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836429.262398:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:3616:x1875730782786176:12345-0@lo:103: 00010000:00010000:2.0:1788836429.262410:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.262414:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 23 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262422:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 23 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262432:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.262457:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:3616:x1875730782786176:12345-0@lo:103: Request processed in 59us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.262463:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836429.262497:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836429.262504:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3616:x1875730782786304:12345-0@lo:103: 00010000:00010000:2.0:1788836429.262510:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.262514:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 22 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262522:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 22 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.262531:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.262552:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3616:x1875730782786304:12345-0@lo:103: Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.262557:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836429.262583:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786048:0@lo:103: 00000100:00100000:2.0:1788836429.262608:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782785536:0@lo:103: 00000100:00100000:2.0:1788836429.262624:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782786304:0@lo:103: 00000100:00100000:2.0:1788836429.262643:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782786176:0@lo:103: 00010000:00010000:2.0:1788836429.262658:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836429.263407:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.263429:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 21 pid: 6485 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263441:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782786432:0@lo:104: 00000100:00100000:3.0:1788836429.263468:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788836429.263483:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40031600/0xf7b38383a6553e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553e21 expref: 21 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263495:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785024:0@lo:104: 00010000:00010000:3.0:1788836429.263504:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553dfe expref: 20 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263512:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785152:0@lo:104: 00010000:00010000:3.0:1788836429.263522:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553de2 expref: 19 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263529:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817baa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785280:0@lo:104: 00010000:00010000:3.0:1788836429.263537:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47c00/0xf7b38383a6553dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553db8 expref: 18 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263544:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785664:0@lo:104: 00010000:00010000:3.0:1788836429.263553:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40030400/0xf7b38383a6553da3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553d9c expref: 17 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.263561:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785792:0@lo:104: 00000100:00100000:2.0:1788836429.263612:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788836429.263629:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.263684:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782785920 00000100:00100000:2.0:1788836429.263689:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782785920 00000100:00100000:0.0:1788836429.263780:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786432 00000100:00100000:0.0:1788836429.263785:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786432 00000100:00100000:0.0:1788836429.264107:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836429.264116:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42649c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785920:12345-0@lo:104: 00010000:00010000:0.0:1788836429.264126:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.264183:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836429.264189:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42649c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6483:x1875730782785920:12345-0@lo:104: Request processed in 76us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.264195:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836429.264229:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836429.264235:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782786432:12345-0@lo:104: 00010000:00010000:0.0:1788836429.264243:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.264271:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836429.264294:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6483:x1875730782786432:12345-0@lo:104: Request processed in 59us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.264299:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788836429.264399:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836429.264405:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264411:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.264415:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264423:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.264429:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.264434:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.264459:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264465:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.264477:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264483:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6553d5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d64 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264503:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836429.264507:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264512:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.264514:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264521:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.264527:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.264532:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.264545:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264550:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.264555:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264560:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f46600/0xf7b38383a6553d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d3a expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264575:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.264576:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.264578:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.264595:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786688:0@lo:103: 00000100:00100000:2.0:1788836429.264630:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.264656:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836429.264662:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786560:0@lo:103: 00000100:00100000:2.0:1788836429.264679:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836429.264700:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.264706:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786688 00000100:00100000:2.0:1788836429.264710:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786688 00010000:00010000:2.0:1788836429.264725:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 17 pid: 6485 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.264746:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786560 00000100:00100000:2.0:1788836429.264749:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786560 00010000:00010000:2.0:1788836429.264759:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 18 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.264770:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836429.264776:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3615:x1875730782786688:12345-0@lo:103: 00010000:00010000:2.0:1788836429.264785:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.264789:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 18 pid: 6485 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264798:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 18 pid: 6485 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264824:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.264852:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3615:x1875730782786688:12345-0@lo:103: Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.264858:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836429.264871:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836429.264876:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3615:x1875730782786560:12345-0@lo:103: 00010000:00010000:2.0:1788836429.264889:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.264894:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 17 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264902:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 17 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264914:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264923:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264935:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264943:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264950:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264956:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264960:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836429.264964:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264971:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.264990:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.265000:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.265050:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3615:x1875730782786560:12345-0@lo:103: Request processed in 173us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.265057:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836429.265087:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786560:0@lo:103: 00000100:00100000:2.0:1788836429.265095:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782786688:0@lo:103: 00010000:00010000:3.0:1788836429.265240:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40031400/0xf7b38383a6553d64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553d5d expref: 16 pid: 6484 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.265261:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782785920:0@lo:104: 00010000:00010000:3.0:1788836429.265272:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40030600/0xf7b38383a6553d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553d33 expref: 15 pid: 6485 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.265294:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6483:1875730782786432:0@lo:104: 00010000:00010000:3.0:1788836429.265322:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.265332:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.265338:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.265345:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836429.265356:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788836429.272241:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:9482:x1875730782784896:12345-0@lo:253: Request processed in 26491us (26758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.272256:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788836429.272365:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782784896:0@lo:253: 10000000:01000000:0.0:1788836429.272381:0:9482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788836429.272385:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836429.272386:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836429.272388:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836429.272389:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788836429.272390:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836429.272391:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836429.272393:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836429.272394:0:9482:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788836429.272396:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836429.272398:0:9482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788836429.272422:0:9482:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adf7fbb1000 from lustre-OST0001 10000000:01000000:0.0:1788836429.272454:0:9482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788836429.272457:0:9482:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788836429.272465:0:9482:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adf48a1cd28 local copy 10000000:01000000:0.0:1788836429.272469:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788836429.272506:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.272516:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.272524:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836429.272542:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782786816:0@lo:101: 00000100:00100000:0.0:1788836429.272581:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.272608:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.273595:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786816 00000100:00100000:1.0:1788836429.273607:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786816 00000100:00100000:1.0:1788836429.273669:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788836429.273678:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+14:9482:x1875730782786816:12345-0@lo:101: 00010000:00010000:1.0:1788836429.273691:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836429.273707:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429ea800/0xf7b38383a6553e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553e4b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.273731:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea800/0xf7b38383a6553e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553e4b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.273742:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429ea800/0xf7b38383a6553e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e4b expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.273751:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea800, rc 0) 00000100:00100000:1.0:1788836429.273806:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:9482:x1875730782786816:12345-0@lo:101: Request processed in 129us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.273812:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788836429.274262:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782786816:0@lo:101: 00010000:00010000:3.0:1788836429.274355:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.274366:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836429.274468:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782786944:0@lo:501: 00000100:00100000:3.0:1788836429.274500:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.283870:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782786944 00000100:00100000:2.0:1788836429.283893:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782786944 00000100:00100000:2.0:1788836429.283967:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788836429.283977:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:9482:x1875730782786944:12345-0@lo:501: 00000100:00100000:2.0:1788836429.284110:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:9482:x1875730782786944:12345-0@lo:501: Request processed in 135us (9610us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836429.284118:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788836429.284231:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.284259:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782786944:0@lo:501: 10000000:01000000:1.0:1788836429.284288:0:9482:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788836429.284318:0:9482:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788836429.284327:0:9482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284337:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284364:0:9482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284388:0:9482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788836429.284418:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf7fbb1000 10000000:01000000:1.0:1788836429.284423:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836429.284429:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788836429.284432:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836429.284437:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788836429.284440:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836429.284469:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284477:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284486:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836429.284503:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787072:0@lo:101: 00000100:00100000:1.0:1788836429.284537:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.284558:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.284573:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787072 00000100:00100000:1.0:1788836429.284577:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787072 00000100:00100000:1.0:1788836429.284599:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788836429.284605:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:9482:x1875730782787072:12345-0@lo:101: 00010000:00010000:1.0:1788836429.284613:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836429.284625:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553e59 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284651:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284662:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284672:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb200, rc 0) 00000100:00100000:1.0:1788836429.284701:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787072:12345-0@lo:101: Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.284706:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788836429.284740:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787072:0@lo:101: 00010000:00010000:1.0:1788836429.284752:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.284761:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836429.284834:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787200:0@lo:501: 00000100:00100000:1.0:1788836429.284859:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.284872:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.284883:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787200 00000100:00100000:1.0:1788836429.284887:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787200 00000100:00100000:1.0:1788836429.284902:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788836429.284907:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787200:12345-0@lo:501: 00000100:00100000:1.0:1788836429.284994:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787200:12345-0@lo:501: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.285000:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788836429.285065:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787200:0@lo:501: 00000100:00100000:1.0:1788836429.285086:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787328:0@lo:503: 00000100:00100000:1.0:1788836429.285121:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.285135:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.285146:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787328 00000100:00100000:1.0:1788836429.285150:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787328 00000100:00100000:1.0:1788836429.285165:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788836429.285170:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787328:12345-0@lo:503: 00000100:00100000:1.0:1788836429.285241:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787328:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.285248:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788836429.285299:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787328:0@lo:503: 00000040:00080000:1.0:1788836429.285538:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836429.285616:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787456:0@lo:502: 00000100:00100000:1.0:1788836429.285652:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.285667:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.285681:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787456 00000100:00100000:1.0:1788836429.285684:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787456 00000100:00100000:1.0:1788836429.285702:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836429.285708:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787456:12345-0@lo:502: 00000100:00100000:1.0:1788836429.285778:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787456:12345-0@lo:502: Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.285785:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836429.285823:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787456:0@lo:502: 00000040:00080000:1.0:1788836429.285993:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788836429.286045:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788836429.286070:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788836429.286085:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788836429.286099:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788836429.286114:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788836429.286133:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787584:0@lo:502: 00000100:00100000:1.0:1788836429.286165:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.286180:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.286194:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787584 00000100:00100000:1.0:1788836429.286197:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787584 00000100:00100000:1.0:1788836429.286217:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788836429.286223:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787584:12345-0@lo:502: 00000100:00100000:1.0:1788836429.286296:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787584:12345-0@lo:502: Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.286302:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788836429.286337:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787584:0@lo:502: 00000040:00080000:1.0:1788836429.286374:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788836429.286381:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:2.0:1788836429.286750:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836429.286758:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.286767:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.286771:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.286791:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.286798:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.286804:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.286829:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.286835:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.286854:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.286861:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7b38383a6553e52 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.286874:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.286876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.286877:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.286885:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836429.286896:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782787712:0@lo:103: 00000100:00100000:2.0:1788836429.286927:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.286963:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787712 00000100:00100000:2.0:1788836429.286967:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787712 00000100:00100000:2.0:1788836429.286996:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836429.287003:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3617:x1875730782787712:12345-0@lo:103: 00010000:00010000:2.0:1788836429.287037:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.287051:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429ea800/0xf7b38383a6553e52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553e4b expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.287070:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.287100:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3617:x1875730782787712:12345-0@lo:103: Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.287106:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836429.287135:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782787712:0@lo:103: 00000020:01000000:3.0:1788836429.287443:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836429.287450:0:9493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788836429.287457:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836429.287459:0:9493:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788836429.287465:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836429.287480:0:9493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8adf817b19b8) 00000020:00000080:3.0:1788836429.287502:0:9493:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788836429.287508:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836429.287580:0:9493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7fbb1000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788836429.287589:0:9493:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836429.287596:0:9493:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7b38383a6553e6e 00010000:00010000:3.0:1788836429.296247:0:9493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788836429.296550:0:9493:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788836429.300449:0:9493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788836429.301413:0:9493:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788836429.308504:0:9493:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788836429.308674:0:9493:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788836429.314907:0:9493:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788836429.316497:0:9493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788836429.316507:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836429.316513:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836429.316515:0:9493:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788836429.316519:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836429.316522:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836429.316524:0:9493:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836429.316527:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836429.316528:0:9493:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836429.316546:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836429.316548:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836429.316549:0:9493:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788836429.316552:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788836429.316694:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788836429.316750:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788836429.316771:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.316783:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.316791:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7fbb1000 from 1 10000000:01000000:0.0:1788836429.316793:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836429.317499:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.317511:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.317521:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836429.317542:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787840:0@lo:101: 00000100:00100000:0.0:1788836429.317604:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.317646:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836429.317717:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787840 00000100:00100000:1.0:1788836429.317724:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787840 00000100:00100000:1.0:1788836429.317779:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788836429.317788:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:9482:x1875730782787840:12345-0@lo:101: 00010000:00010000:1.0:1788836429.317801:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836429.317824:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553e75 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.317846:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.317856:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.317865:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eba00, rc 0) 00000100:00100000:1.0:1788836429.317904:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787840:12345-0@lo:101: Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.317910:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788836429.322416:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787840:0@lo:101: 00010000:00010000:0.0:1788836429.322448:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.322461:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836429.322580:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787968:0@lo:501: 00000100:00100000:0.0:1788836429.322649:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.322688:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.322721:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782787968 00000100:00100000:0.0:1788836429.322728:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782787968 00000100:00100000:0.0:1788836429.322768:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788836429.322776:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787968:12345-0@lo:501: 00000100:00100000:0.0:1788836429.322907:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782787968:12345-0@lo:501: Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.322915:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788836429.322956:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782787968:0@lo:501: 00000100:00100000:0.0:1788836429.322981:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788096:0@lo:503: 00000100:00100000:0.0:1788836429.323043:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.323058:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.323070:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788096 00000100:00100000:0.0:1788836429.323074:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788096 00000100:00100000:0.0:1788836429.323095:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788836429.323100:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788096:12345-0@lo:503: 00000100:00100000:0.0:1788836429.323172:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788096:12345-0@lo:503: Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.323178:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788836429.323218:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788096:0@lo:503: 00000040:00080000:0.0:1788836429.323445:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836429.323517:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788224:0@lo:502: 00000100:00100000:0.0:1788836429.323550:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.323565:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.323582:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788224 00000100:00100000:0.0:1788836429.323592:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788224 00000100:00100000:0.0:1788836429.323615:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836429.323620:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788224:12345-0@lo:502: 00000100:00100000:0.0:1788836429.323701:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788224:12345-0@lo:502: Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.323707:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836429.323745:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788224:0@lo:502: 00000040:00080000:0.0:1788836429.323910:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788836429.323933:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788836429.323953:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788352:0@lo:502: 00000100:00100000:0.0:1788836429.323984:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.323998:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.324032:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788352 00000100:00100000:0.0:1788836429.324036:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788352 00000100:00100000:0.0:1788836429.324059:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788836429.324065:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788352:12345-0@lo:502: 00000100:00100000:0.0:1788836429.324125:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788352:12345-0@lo:502: Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.324130:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788836429.324169:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788352:0@lo:502: 00000040:00080000:0.0:1788836429.324202:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788836429.324209:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788836429.340590:0:9497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836429.340602:0:9497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836429.340605:0:9497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836429.340612:0:9497:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf7fbb1000 00000020:00000080:3.0:1788836429.340616:0:9497:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836429.340627:0:9497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836429.340629:0:9497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836429.340631:0:9497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836429.340634:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788836429.340843:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788836429.340876:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836429.340900:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.340926:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.340985:0:9482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836429.340988:0:9482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf7fbb1000 10000000:01000000:0.0:1788836429.340991:0:9482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf7fbb1000 10000000:01000000:0.0:1788836429.340995:0:9482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836429.341001:0:9482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf7fbb1000 from 1 10000000:01000000:0.0:1788836429.341004:0:9482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836429.341062:0:9482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.341070:0:9482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.341081:0:9482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836429.341102:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788480:0@lo:101: 00000100:00100000:0.0:1788836429.341164:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.341204:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836429.341353:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788480 00000100:00100000:3.0:1788836429.341361:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788480 00000100:00100000:3.0:1788836429.341408:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788836429.341417:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:9482:x1875730782788480:12345-0@lo:101: 00010000:00010000:3.0:1788836429.341432:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836429.341444:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553e83 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.341479:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.341489:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.341498:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700200, rc 0) 00000100:00100000:3.0:1788836429.341546:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788480:12345-0@lo:101: Request processed in 130us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836429.341552:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788836429.341640:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788480:0@lo:101: 00010000:00010000:2.0:1788836429.341654:0:9482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.341663:0:9482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.341766:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788608:0@lo:501: 00000100:00100000:2.0:1788836429.341794:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.341814:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.341914:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788608 00000100:00100000:0.0:1788836429.341919:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788608 00000100:00100000:0.0:1788836429.341949:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836429.342070:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788608:12345-0@lo:501: 00000100:00100000:0.0:1788836429.342167:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788608:12345-0@lo:501: Request processed in 99us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.344504:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788608:0@lo:501: 00000100:00100000:2.0:1788836429.344557:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788736:0@lo:503: 00000100:00100000:2.0:1788836429.344626:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.344652:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.347482:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836429.347554:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788736 00000100:00100000:0.0:1788836429.347563:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788736 00000100:00100000:0.0:1788836429.347596:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836429.347605:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788736:12345-0@lo:503: 00000100:00100000:0.0:1788836429.347890:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788736:12345-0@lo:503: Request processed in 285us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.347897:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788836429.348007:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788736:0@lo:503: 00000040:00080000:3.0:1788836429.348388:0:9482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836429.348459:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788864:0@lo:502: 00000100:00100000:3.0:1788836429.348504:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.348535:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.348579:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788864 00000100:00100000:0.0:1788836429.348583:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788864 00000100:00100000:0.0:1788836429.348617:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836429.348624:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788864:12345-0@lo:502: 00000100:00100000:0.0:1788836429.348709:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788864:12345-0@lo:502: Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.348717:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788836429.348950:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788864:0@lo:502: 00000040:00080000:3.0:1788836429.349188:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788836429.349212:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788836429.349225:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788836429.349237:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788836429.349249:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788836429.349261:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788836429.349286:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788836429.349314:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788836429.349329:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788836429.349342:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788836429.349353:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788836429.349376:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788836429.349389:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788836429.349400:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788836429.349412:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788836429.349424:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788836429.349436:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788836429.349448:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788836429.349460:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788836429.349472:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788836429.349483:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788836429.349495:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788836429.349506:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788836429.349529:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788836429.349542:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788836429.349553:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788836429.349564:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788836429.349576:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788836429.349588:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788836429.349600:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788836429.349613:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788836429.349625:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788836429.349637:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788836429.349649:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788836429.349661:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788836429.349673:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788836429.349685:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788836429.350508:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788836429.350551:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788836429.350565:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788836429.350591:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788836429.350603:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788836429.350615:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788836429.350627:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788836429.350639:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788836429.350651:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788836429.350687:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788992:0@lo:502: 00000100:00100000:2.0:1788836429.351209:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.351302:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.351362:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782788992 00000100:00100000:0.0:1788836429.351370:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782788992 00000100:00100000:0.0:1788836429.351456:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788836429.351465:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788992:12345-0@lo:502: 00000100:00100000:0.0:1788836429.351587:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782788992:12345-0@lo:502: Request processed in 123us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.351594:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788836429.351672:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782788992:0@lo:502: 00000040:00080000:3.0:1788836429.351747:0:9482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788836429.351757:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788836429.352364:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788836429.352379:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adf817b4d28) 00000020:00000080:3.0:1788836429.352402:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788836429.352501:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7fbb1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788836429.352506:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7fbb1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788836429.352508:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7fbb1000 3 00010000:00080000:3.0:1788836429.352535:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf8145b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788836429.354692:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788836429.354903:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788836429.354946:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836429.354958:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7b38383a6553e98 00000100:00080000:3.0:1788836429.354969:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836429.354975:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adf8145b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836429.355030:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf444f9500 x1875730782789120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836429.355049:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788836429.355171:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782789632:0@lo:400: 00000100:00100000:3.0:1788836429.355234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.355255:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782789120:0@lo:38: 00000100:00100000:3.0:1788836429.355266:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782790144:0@lo:400: 00000100:00100000:0.0:1788836429.355423:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.355467:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789120 00000100:00100000:0.0:1788836429.355473:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789120 00000100:00100000:0.0:1788836429.355502:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836429.355509:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782789120:12345-0@lo:38: 00010000:00080000:0.0:1788836429.355540:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788836429.355570:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7b38383a6553e9f 00000004:00100000:0.0:1788836429.355584:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836429.355614:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836429.355663:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875730782789120:12345-0@lo:38: Request processed in 153us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.355670:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788836429.355707:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f9500 x1875730782789120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836429.355717:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836429.355725:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788836429.355730:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836429.355734:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836429.355736:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836429.355743:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782789120:0@lo:38: 00000100:00100000:3.0:1788836429.359591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.359688:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788836429.359711:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782789248:0@lo:400: 00000100:00100000:2.0:1788836429.359716:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782789376:0@lo:400: 00000100:00100000:3.0:1788836429.359741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.359744:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.359762:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782789760:0@lo:400: 00000100:00100000:2.0:1788836429.359763:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782789888:0@lo:400: 00000100:00100000:2.0:1788836429.359781:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.359798:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836429.359804:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782789504:0@lo:400: 00000100:00100000:3.0:1788836429.359818:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.359836:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789632 00000100:00100000:2.0:1788836429.359843:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789632 00000100:00100000:3.0:1788836429.359856:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789376 00000100:00100000:3.0:1788836429.359859:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789376 00000100:00100000:2.0:1788836429.359890:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836429.360396:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790144 00000100:00100000:0.0:1788836429.360401:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790144 00000100:00100000:0.0:1788836429.360440:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836429.360448:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782790144:12345-0@lo:400: 00000100:00100000:0.0:1788836429.360504:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782790144:12345-0@lo:400: Request processed in 57us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.360512:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836429.360536:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789248 00000100:00100000:0.0:1788836429.360539:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789248 00000100:00100000:0.0:1788836429.360554:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789888 00000100:00100000:0.0:1788836429.360556:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789888 00000100:00100000:0.0:1788836429.360580:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789760 00000100:00100000:0.0:1788836429.360582:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789760 00000100:00100000:0.0:1788836429.360597:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836429.360602:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782789248:12345-0@lo:400: 00000100:00100000:0.0:1788836429.360632:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782789248:12345-0@lo:400: Request processed in 30us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.360638:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836429.360649:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836429.360654:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782789888:12345-0@lo:400: 00000100:00100000:0.0:1788836429.360678:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782789888:12345-0@lo:400: Request processed in 24us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.360683:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836429.360694:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836429.360712:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782789760:12345-0@lo:400: 00000100:00100000:0.0:1788836429.360736:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782789760:12345-0@lo:400: Request processed in 25us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.360742:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788836429.360777:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8e00 x1875730782789248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836429.360790:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782789248:0@lo:400: 00010000:00080000:0.0:1788836429.360800:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade436f9500 x1875730782789760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836429.360822:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782789760:0@lo:400: 00010000:00080000:0.0:1788836429.360833:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade436faa00 x1875730782790144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836429.360861:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782790144:0@lo:400: 00000100:00080000:1.0:1788836429.361255:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836429.361261:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836429.361263:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836429.361609:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836429.361613:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782789376:12345-0@lo:400: 00000100:00100000:3.0:1788836429.361619:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782789632:12345-0@lo:400: 00000100:00100000:2.0:1788836429.361665:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782789376:12345-0@lo:400: Request processed in 68us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836429.361666:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782789632:12345-0@lo:400: Request processed in 51us (6433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.361671:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836429.361680:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836429.361724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.361762:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782790016:0@lo:400: 00000100:00100000:3.0:1788836429.361763:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782789504 00000100:00100000:3.0:1788836429.361768:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782789504 00000100:00100000:3.0:1788836429.361792:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836429.361793:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.361822:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782789376:0@lo:400: 00010000:00080000:1.0:1788836429.361834:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade436f8000 x1875730782789888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836429.361842:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782789888:0@lo:400: 00000100:00100000:1.0:1788836429.361874:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790016 00000100:00100000:1.0:1788836429.361877:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790016 00000100:00100000:1.0:1788836429.361910:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836429.361916:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782790016:12345-0@lo:400: 00000100:00100000:1.0:1788836429.361953:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782790016:12345-0@lo:400: Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.361959:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788836429.361977:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836429.361996:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782789504:12345-0@lo:400: 00010000:00080000:1.0:1788836429.361996:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade436f8e00 x1875730782790016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836429.362005:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782790016:0@lo:400: 00000100:00100000:3.0:1788836429.362055:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782789504:12345-0@lo:400: Request processed in 256us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836429.362061:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788836429.362063:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8380 x1875730782789504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836429.362072:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782789504:0@lo:400: 00000020:01000004:1.0:1788836429.362891:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788836429.362922:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ade437019b8) 00000020:00000080:1.0:1788836429.362944:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788836429.363035:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf7fbb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836429.363039:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7fbb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836429.363042:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7fbb1000 3 00010000:00080000:1.0:1788836429.363069:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade42b73800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836429.364654:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788836429.364844:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788836429.364886:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836429.364898:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf7b38383a6553ead 00000100:00080000:1.0:1788836429.364908:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836429.364913:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ade42b73800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836429.364961:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a7ae680 x1875730782790272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836429.364986:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788836429.367401:0:9500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1875730782790400:0@lo:901: 00000100:00100000:3.0:1788836429.368110:0:9500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.368153:0:9500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7863f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836429.368404:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790400 00000100:00100000:2.0:1788836429.368412:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790400 00000100:00100000:2.0:1788836429.368478:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836429.368487:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1875730782790400:12345-0@lo:901: 00000100:00100000:2.0:1788836429.368584:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1875730782790400:12345-0@lo:901: Request processed in 97us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.368600:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836429.370926:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782790272:0@lo:38: 00000100:00100000:1.0:1788836429.370999:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.371078:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790272 00000100:00100000:1.0:1788836429.371085:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790272 00000100:00100000:1.0:1788836429.371118:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836429.371125:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782790272:12345-0@lo:38: 00010000:00080000:1.0:1788836429.371155:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1788836429.371193:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf7b38383a6553eb4 00000004:00100000:1.0:1788836429.371207:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836429.371237:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8ade42b75800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836429.371294:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875730782790272:12345-0@lo:38: Request processed in 167us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.371302:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788836429.371342:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a7ae680 x1875730782790272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836429.371352:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836429.371361:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788836429.371369:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836429.371373:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788836429.371375:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade42b73800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836429.371380:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782790272:0@lo:38: 00000100:00100000:1.0:1788836429.371414:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782789632:0@lo:400: 00000100:00080000:3.0:1788836429.371534:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836429.371570:0:9500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade436f9f80 x1875730782790400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788836445 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836429.371579:0:9500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1875730782790400:0@lo:901: 00000040:00080000:0.0:1788836429.375197:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788836429.375302:0:9482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788836429.375341:0:9482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836429.375363:0:9482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.375375:0:9482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788836429.375425:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788836429.375427:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836429.375429:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836429.375430:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836429.375431:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836429.375437:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836429.375439:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836429.375440:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836429.375441:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836429.375443:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836429.375444:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836429.375448:0:9482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788836429.375450:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836429.375451:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836429.375452:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836429.375453:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836429.375454:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836429.375455:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836429.375456:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836429.375457:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836429.375457:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836429.375458:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836429.375459:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836429.375485:0:9482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836429.375503:0:9482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782790528:0@lo:253: 00000100:00100000:3.0:1788836429.375570:0:9482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.375616:0:9482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7863f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836429.375946:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790528 00000100:00100000:0.0:1788836429.375954:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790528 00000100:00100000:0.0:1788836429.376005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788836429.376033:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782790528:12345-0@lo:253: 20000000:01000000:0.0:1788836429.376059:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788836429.376074:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836429.384863:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836429.384893:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788836429.384920:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788836429.384925:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788836429.384948:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.384967:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553daa expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.384976:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.384983:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.385160:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.385175:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 17 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.385189:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782790656:0@lo:104: 00000100:00100000:2.0:1788836429.385226:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.385236:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:9482:x1875730782790528:12345-0@lo:253: Request processed in 9222us (9664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.385247:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00010000:2.0:1788836429.385315:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.385324:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.385332:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782790784:0@lo:104: 00000100:00100000:2.0:1788836429.385370:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836429.385440:0:9482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:9482:1875730782790528:0@lo:253: 10000000:01000000:3.0:1788836429.385452:0:9482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836429.385456:0:9482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836429.385457:0:9482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836429.385458:0:9482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836429.385459:0:9482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836429.385461:0:9482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836429.385462:0:9482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836429.385464:0:9482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836429.385465:0:9482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836429.385466:0:9482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836429.385468:0:9482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836429.385469:0:9482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788836429.385482:0:9482:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788836429.390115:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2d0c0 going to sleep for 11 seconds 00080000:10000000:3.0:1788836429.390530:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788836429.390739:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788836429.390940:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788836429.391126:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788836429.391328:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788836429.391542:0:9482:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788836429.393114:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790656 00000100:00100000:1.0:1788836429.393127:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790656 00000100:00100000:1.0:1788836429.393182:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790784 00000100:00100000:1.0:1788836429.393186:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790784 00000100:00100000:1.0:1788836429.393205:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836429.393214:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782790656:12345-0@lo:104: 00010000:00010000:1.0:1788836429.393231:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.393324:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836429.393331:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:6506:x1875730782790656:12345-0@lo:104: Request processed in 118us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.393338:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836429.393356:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836429.393363:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782790784:12345-0@lo:104: 00010000:00010000:1.0:1788836429.393370:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.393403:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836429.393408:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:6506:x1875730782790784:12345-0@lo:104: Request processed in 47us (8038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.393414:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836429.393514:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782790656:0@lo:104: 00000100:00100000:2.0:1788836429.393524:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1875730782790784:0@lo:104: 00010000:00010000:2.0:1788836429.393548:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393566:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836429.393572:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393580:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.393584:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393592:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.393601:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.393606:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.393644:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393651:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.393670:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393677:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a6553df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553df7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393865:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836429.393870:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393876:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836429.393879:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393886:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836429.393892:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836429.393896:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836429.393912:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393918:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836429.393939:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393945:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701800/0xf7b38383a6553daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553db1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.393957:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.393959:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.393960:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836429.393966:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.393984:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782790912:0@lo:103: 00000100:00100000:2.0:1788836429.394053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.394099:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836429.394106:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782791040:0@lo:103: 00000100:00100000:2.0:1788836429.394128:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.394152:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782790912 00000100:00100000:2.0:1788836429.394157:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782790912 00010000:00010000:2.0:1788836429.394176:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 17 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.394194:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791040 00000100:00100000:2.0:1788836429.394197:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791040 00010000:00010000:2.0:1788836429.394207:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 18 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.394218:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836429.394224:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3617:x1875730782790912:12345-0@lo:103: 00010000:00010000:2.0:1788836429.394235:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.394239:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 18 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394250:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 18 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394263:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46000/0xf7b38383a6553df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553df0 expref: 18 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394283:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.394313:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3617:x1875730782790912:12345-0@lo:103: Request processed in 89us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.394329:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836429.394343:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836429.394349:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3615:x1875730782791040:12345-0@lo:103: 00010000:00010000:2.0:1788836429.394356:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836429.394360:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394368:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394379:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eb600/0xf7b38383a6553db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553daa expref: 16 pid: 6483 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394389:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394397:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788836429.394410:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009485845s 00010000:00010000:2.0:1788836429.394414:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394420:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394426:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394432:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394443:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836429.394447:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394455:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394468:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394477:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836429.394503:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3615:x1875730782791040:12345-0@lo:103: Request processed in 154us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.394510:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836429.394540:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782791040:0@lo:103: 00010000:00010000:2.0:1788836429.394556:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394564:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.394571:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46600/0xf7b38383a6553ebb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836429.394591:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782790912:0@lo:103: 00000001:00000004:3.0:1788836429.395658:0:9482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788836429.403794:0:9482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788836429.403805:0:9482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788836429.403839:0:9482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788836429.403879:0:9482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788836429.403898:0:9482:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788836429.403919:0:9482:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788836429.404943:0:9482:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836429.419574:0:9482:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788836430.206641:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836430.408324:0:9556:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836430.408509:0:9556:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836431.230453:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836431.614112:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836431.614149:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782791168:0@lo:41: 00000100:00100000:3.0:1788836431.614217:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836431.614264:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791168 00000100:00100000:0.0:1788836431.614273:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791168 00000100:00100000:0.0:1788836431.614368:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836431.614379:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782791168:12345-0@lo:41: 00000004:00000024:0.0:1788836431.614413:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788836431.614470:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782791168:12345-0@lo:41: Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836431.614477:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836431.614506:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782791168:0@lo:41: 00010000:00010000:1.0:1788836432.258148:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836432.639196:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782791296:0@lo:13: 00000100:00100000:0.0:1788836432.639276:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836432.639361:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791296 00000100:00100000:0.0:1788836432.639368:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791296 00000100:00100000:0.0:1788836432.639429:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836432.639438:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782791296:12345-0@lo:13: 00002000:00000024:0.0:1788836432.639465:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836432.639509:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782791296:12345-0@lo:13: Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836432.639516:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788836432.639538:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836432.639567:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428db100 x1875730782791296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836432.639586:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782791296:0@lo:13: 00000100:00100000:1.0:1788836432.640171:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782791424:0@lo:13: 00000100:00100000:1.0:1788836432.640204:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836432.640338:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791424 00000100:00100000:3.0:1788836432.640343:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791424 00000100:00100000:3.0:1788836432.640412:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836432.640419:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782791424:12345-0@lo:13: 00002000:00000024:3.0:1788836432.640432:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836432.640468:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782791424:12345-0@lo:13: Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836432.640474:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788836432.641088:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f8380 x1875730782791424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836432.641105:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782791424:0@lo:13: 00000100:00080000:1.0:1788836432.643001:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836433.280704:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836433.662285:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836433.662443:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782791552:0@lo:41: 00000100:00100000:3.0:1788836433.662515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836433.664570:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791552 00000100:00100000:2.0:1788836433.664585:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791552 00000100:00100000:2.0:1788836433.664656:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836433.664667:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782791552:12345-0@lo:41: 00000004:00000024:2.0:1788836433.664703:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788836433.664778:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782791552:12345-0@lo:41: Request processed in 112us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836433.664785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836433.664838:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782791552:0@lo:41: 00010000:00010000:3.0:1788836434.302421:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836434.690635:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836434.690708:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836434.690733:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782792064:0@lo:400: 00000100:00100000:3.0:1788836434.690812:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836434.690874:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792064 00000100:00100000:3.0:1788836434.690881:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792064 00000100:00100000:3.0:1788836434.690930:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836434.690939:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782792064:12345-0@lo:400: 00000100:00100000:3.0:1788836434.690990:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782792064:12345-0@lo:400: Request processed in 53us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836434.690998:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788836434.691247:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a4380 x1875730782792064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836434.691260:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782792064:0@lo:400: 00000100:00100000:0.0:1788836434.691327:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782791808:0@lo:400: 00000100:00100000:0.0:1788836434.691357:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836434.691389:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836434.691395:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782791936:0@lo:400: 00000100:00100000:0.0:1788836434.691421:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836434.691460:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791936 00000100:00100000:0.0:1788836434.691464:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791936 00000100:00100000:0.0:1788836434.691494:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836434.691501:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782791936:12345-0@lo:400: 00000100:00100000:0.0:1788836434.691539:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782791936:12345-0@lo:400: Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836434.691545:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836434.691576:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782791936:0@lo:400: 00000100:00100000:3.0:1788836434.694377:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791808 00000100:00100000:3.0:1788836434.694392:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791808 00000100:00100000:3.0:1788836434.694455:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836434.694465:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782791808:12345-0@lo:400: 00000100:00100000:3.0:1788836434.694555:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782791808:12345-0@lo:400: Request processed in 91us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836434.694562:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788836434.694610:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7736b480 x1875730782791808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836434.694624:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782791808:0@lo:400: 00000100:00100000:1.0:1788836434.694856:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782791680:0@lo:400: 00000100:00100000:1.0:1788836434.694907:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836434.696138:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782791680 00000100:00100000:3.0:1788836434.696149:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782791680 00000100:00100000:3.0:1788836434.696205:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788836434.696215:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3614:x1875730782791680:12345-0@lo:400: 00000100:00100000:3.0:1788836434.696282:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3614:x1875730782791680:12345-0@lo:400: Request processed in 69us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836434.696295:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836434.696557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782792320:0@lo:400: 00000100:00100000:2.0:1788836434.696589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836434.696610:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782792832:0@lo:400: 00000100:00100000:2.0:1788836434.696630:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836434.696646:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836434.696651:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782792448:0@lo:400: 00000100:00100000:2.0:1788836434.696669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836434.696681:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782792960:0@lo:400: 00000100:00100000:2.0:1788836434.696700:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836434.696719:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792320 00000100:00100000:2.0:1788836434.696723:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792320 00000100:00100000:2.0:1788836434.696755:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792832 00000100:00100000:2.0:1788836434.696758:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792832 00000100:00100000:2.0:1788836434.696770:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792448 00000100:00100000:2.0:1788836434.696772:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792448 00000100:00100000:2.0:1788836434.696782:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792960 00000100:00100000:2.0:1788836434.696789:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792960 00000100:00100000:2.0:1788836434.696808:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836434.696815:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782792320:12345-0@lo:400: 00000100:00100000:2.0:1788836434.696852:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782792320:12345-0@lo:400: Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836434.696858:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836434.696871:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836434.696876:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782792832:12345-0@lo:400: 00000100:00100000:2.0:1788836434.696902:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782792832:12345-0@lo:400: Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836434.696909:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836434.696919:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836434.696925:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782792448:12345-0@lo:400: 00000100:00100000:2.0:1788836434.696949:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782792448:12345-0@lo:400: Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836434.696954:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836434.696965:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788836434.696971:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782792960:12345-0@lo:400: 00000100:00100000:2.0:1788836434.696995:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782792960:12345-0@lo:400: Request processed in 24us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836434.697001:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788836434.697045:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836434.697049:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788836434.697076:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a4380 x1875730782792448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836434.697089:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782792448:0@lo:400: 00010000:00080000:2.0:1788836434.697110:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43899880 x1875730782792960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836434.697119:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782792960:0@lo:400: 00010000:00080000:2.0:1788836434.697128:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a7100 x1875730782792320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836434.697135:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782792320:0@lo:400: 00010000:00080000:2.0:1788836434.697144:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389a680 x1875730782792832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836434.697151:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782792832:0@lo:400: 00000100:00100000:1.0:1788836434.697614:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782792576:0@lo:400: 00000100:00100000:1.0:1788836434.697647:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836434.697684:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782791680:0@lo:400: 00000100:00100000:1.0:1788836434.697696:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836434.697701:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782792192:0@lo:400: 00000100:00100000:1.0:1788836434.697724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836434.697742:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782792704:0@lo:400: 00000100:00100000:1.0:1788836434.697761:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836434.698145:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792576 00000100:00100000:0.0:1788836434.698151:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792576 00000100:00100000:0.0:1788836434.698211:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792704 00000100:00100000:0.0:1788836434.698214:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792704 00000100:00100000:0.0:1788836434.698237:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836434.698245:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782792576:12345-0@lo:400: 00000100:00100000:0.0:1788836434.698291:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782792576:12345-0@lo:400: Request processed in 47us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836434.698297:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836434.698311:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836434.698317:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782792704:12345-0@lo:400: 00000100:00100000:0.0:1788836434.698342:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782792704:12345-0@lo:400: Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836434.698348:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788836434.698382:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43898700 x1875730782792704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836434.698394:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782792704:0@lo:400: 00010000:00080000:0.0:1788836434.698404:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389ad80 x1875730782792576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836434.698412:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782792576:0@lo:400: 00000100:00100000:3.0:1788836434.698583:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782792192 00000100:00100000:3.0:1788836434.698588:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782792192 00000100:00100000:3.0:1788836434.698619:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836434.698626:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782792192:12345-0@lo:400: 00000100:00100000:3.0:1788836434.698667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782792192:12345-0@lo:400: Request processed in 42us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836434.698674:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836434.698700:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782792192:0@lo:400: 00000100:00080000:1.0:1788836434.699553:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836435.326731:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788836435.561943:0:9845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788836436.351281:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788836436.449429:0:9897:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836436.449680:0:9897:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788836436.735782:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782793088:0@lo:41: 00000100:00100000:3.0:1788836436.735863:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836436.736555:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793088 00000100:00100000:0.0:1788836436.736563:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793088 00000100:00100000:0.0:1788836436.736702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836436.736712:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782793088:12345-0@lo:41: 00000004:00000024:0.0:1788836436.736748:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788836436.736811:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782793088:12345-0@lo:41: Request processed in 100us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836436.736831:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836436.736901:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782793088:0@lo:41: 00010000:00010000:2.0:1788836437.374281:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836437.758670:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782793216:0@lo:13: 00000100:00100000:1.0:1788836437.758758:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836437.758947:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793216 00000100:00100000:3.0:1788836437.758957:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793216 00000100:00100000:3.0:1788836437.759048:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836437.759061:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782793216:12345-0@lo:13: 00002000:00000024:3.0:1788836437.759093:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836437.759151:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782793216:12345-0@lo:13: Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836437.759157:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788836437.759310:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836437.759339:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436fb480 x1875730782793216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836437.759358:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782793216:0@lo:13: 00000100:00100000:1.0:1788836437.759519:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836437.759530:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782793344:0@lo:13: 00000100:00100000:1.0:1788836437.759561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836437.759679:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793344 00000100:00100000:3.0:1788836437.759684:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793344 00000100:00100000:3.0:1788836437.759723:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836437.759729:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782793344:12345-0@lo:13: 00002000:00000024:3.0:1788836437.759740:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836437.759777:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782793344:12345-0@lo:13: Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836437.759802:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788836437.759933:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836437.760045:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389a680 x1875730782793344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836437.760060:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782793344:0@lo:13: 00010000:00010000:1.0:1788836438.413884:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836438.787216:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836438.787244:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782793472:0@lo:41: 00000100:00100000:0.0:1788836438.787317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836438.787417:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793472 00000100:00100000:2.0:1788836438.787424:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793472 00000100:00100000:2.0:1788836438.787477:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836438.787486:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782793472:12345-0@lo:41: 00000004:00000024:2.0:1788836438.787520:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788836438.787571:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782793472:12345-0@lo:41: Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836438.787579:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836438.787624:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782793472:0@lo:41: 00000020:00000004:0.0:1788836439.009457:0:9999:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836439.009670:0:9999:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788836439.294142:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788836439.294151:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf7a54e000 from 39 10000000:01000000:1.0:1788836439.294157:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836439.294206:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.294217:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.294229:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.294254:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793600:0@lo:101: 00000100:00100000:1.0:1788836439.294325:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.294395:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.295225:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793600 00000100:00100000:0.0:1788836439.295235:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793600 00000100:00100000:0.0:1788836439.295298:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788836439.295308:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782793600:12345-0@lo:101: 00010000:00010000:0.0:1788836439.295323:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836439.295339:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ec2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.295365:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.295376:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.295384:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:0.0:1788836439.295442:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782793600:12345-0@lo:101: Request processed in 135us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.295449:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788836439.295550:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793600:0@lo:101: 00010000:00010000:1.0:1788836439.295566:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.295576:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.295641:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793728:0@lo:501: 00000100:00100000:1.0:1788836439.295669:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.295708:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.295770:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793728 00000100:00100000:3.0:1788836439.295775:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793728 00000100:00100000:3.0:1788836439.295810:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788836439.295817:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782793728:12345-0@lo:501: 00000100:00100000:3.0:1788836439.295947:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782793728:12345-0@lo:501: Request processed in 130us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.295953:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788836439.296476:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793728:0@lo:501: 00000100:00100000:2.0:1788836439.296541:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793856:0@lo:503: 00000100:00100000:2.0:1788836439.296588:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.296607:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.297045:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793856 00000100:00100000:1.0:1788836439.297051:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793856 00000100:00100000:1.0:1788836439.297078:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788836439.297085:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782793856:12345-0@lo:503: 00000100:00100000:1.0:1788836439.297204:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782793856:12345-0@lo:503: Request processed in 119us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.297212:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788836439.299078:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782793856:0@lo:503: 00000100:00100000:1.0:1788836439.300082:0:10011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10011:1875730782793984:0@lo:502: 00000100:00100000:1.0:1788836439.300169:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.300207:0:10011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.300620:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782793984 00000100:00100000:0.0:1788836439.300627:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782793984 00000100:00100000:0.0:1788836439.300681:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788836439.300691:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10011:x1875730782793984:12345-0@lo:502: 00000100:00100000:0.0:1788836439.300834:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10011:x1875730782793984:12345-0@lo:502: Request processed in 144us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.300841:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836439.300905:0:10011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10011:1875730782793984:0@lo:502: 00000100:00100000:2.0:1788836439.300953:0:10011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10011:1875730782794112:0@lo:502: 00000100:00100000:2.0:1788836439.300987:0:10011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.301042:0:10011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.301202:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794112 00000100:00100000:1.0:1788836439.301207:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794112 00000100:00100000:1.0:1788836439.301240:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788836439.301247:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10011:x1875730782794112:12345-0@lo:502: 00000100:00100000:1.0:1788836439.301314:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10011:x1875730782794112:12345-0@lo:502: Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.301320:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788836439.301628:0:10011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10011:1875730782794112:0@lo:502: 00000040:00080000:2.0:1788836439.301649:0:10011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788836439.302073:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788836439.302097:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836439.302122:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.302132:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836439.302142:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788836439.302144:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788836439.302147:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788836439.302173:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.302182:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.302192:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.302211:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794240:0@lo:101: 00000100:00100000:0.0:1788836439.302248:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.302278:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.302439:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794240 00000100:00100000:2.0:1788836439.302444:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794240 00000100:00100000:2.0:1788836439.302472:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788836439.302479:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782794240:12345-0@lo:101: 00010000:00010000:2.0:1788836439.302490:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836439.302501:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ed0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.302521:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.302532:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.302540:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47400, rc 0) 00000100:00100000:2.0:1788836439.302582:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794240:12345-0@lo:101: Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.302594:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788836439.303793:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794240:0@lo:101: 00010000:00010000:3.0:1788836439.303818:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.303830:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836439.303908:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794368:0@lo:501: 00000100:00100000:3.0:1788836439.303952:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.303998:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.304055:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794368 00000100:00100000:2.0:1788836439.304061:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794368 00000100:00100000:2.0:1788836439.304093:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788836439.304116:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794368:12345-0@lo:501: 00000100:00100000:2.0:1788836439.304240:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794368:12345-0@lo:501: Request processed in 140us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.304247:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788836439.305807:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794368:0@lo:501: 00000100:00100000:3.0:1788836439.305858:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794496:0@lo:503: 00000100:00100000:3.0:1788836439.305918:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.305959:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.306110:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794496 00000100:00100000:0.0:1788836439.306117:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794496 00000100:00100000:0.0:1788836439.306161:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788836439.306170:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794496:12345-0@lo:503: 00000100:00100000:0.0:1788836439.306290:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794496:12345-0@lo:503: Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.306298:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788836439.306919:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794496:0@lo:503: 00000100:00100000:3.0:1788836439.308767:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10013:1875730782794624:0@lo:502: 00000100:00100000:3.0:1788836439.308840:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.309635:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.310622:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794624 00000100:00100000:2.0:1788836439.310633:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794624 00000100:00100000:2.0:1788836439.310737:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836439.310748:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10013:x1875730782794624:12345-0@lo:502: 00000100:00100000:2.0:1788836439.310907:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10013:x1875730782794624:12345-0@lo:502: Request processed in 160us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.310916:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788836439.311026:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10013:1875730782794624:0@lo:502: 00000020:01000000:3.0:1788836439.311054:0:10013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836439.311063:0:10013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836439.311065:0:10013:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788836439.311070:0:10013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788836439.311072:0:10013:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788836439.311096:0:10013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10013:1875730782794752:0@lo:502: 00000100:00100000:3.0:1788836439.311144:0:10013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.318447:0:10013:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.318550:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794752 00000100:00100000:0.0:1788836439.318560:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794752 00000100:00100000:0.0:1788836439.318615:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788836439.318625:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10013:x1875730782794752:12345-0@lo:502: 00000100:00100000:0.0:1788836439.318773:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10013:x1875730782794752:12345-0@lo:502: Request processed in 148us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.318781:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788836439.318964:0:10013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10013:1875730782794752:0@lo:502: 00000020:01000000:3.0:1788836439.319028:0:10013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836439.319037:0:10013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836439.319039:0:10013:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788836439.319045:0:10013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788836439.319275:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788836439.319296:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788836439.319306:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.319318:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836439.319327:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788836439.319330:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf444f2000 from 39 10000000:01000000:0.0:1788836439.319332:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836439.319361:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.319370:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.319379:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.319408:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794880:0@lo:101: 00000100:00100000:0.0:1788836439.319444:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.319479:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.319584:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782794880 00000100:00100000:3.0:1788836439.319589:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782794880 00000100:00100000:3.0:1788836439.319612:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788836439.319618:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782794880:12345-0@lo:101: 00010000:00010000:3.0:1788836439.319628:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836439.319640:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ede expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.319662:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ede expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.319672:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ede expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.319680:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700800, rc 0) 00000100:00100000:3.0:1788836439.319725:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782794880:12345-0@lo:101: Request processed in 107us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.319733:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788836439.319801:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782794880:0@lo:101: 00010000:00010000:0.0:1788836439.319814:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.319823:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.319876:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795008:0@lo:501: 00000100:00100000:0.0:1788836439.319899:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.319920:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.319961:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795008 00000100:00100000:3.0:1788836439.319965:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795008 00000100:00100000:3.0:1788836439.319983:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788836439.319990:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782795008:12345-0@lo:501: 00000100:00100000:3.0:1788836439.320203:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782795008:12345-0@lo:501: Request processed in 214us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.320210:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788836439.320278:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795008:0@lo:501: 00000100:00100000:0.0:1788836439.320301:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795136:0@lo:503: 00000100:00100000:0.0:1788836439.320339:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.320367:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.322312:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795136 00000100:00100000:3.0:1788836439.322328:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795136 00000100:00100000:3.0:1788836439.322373:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788836439.322382:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782795136:12345-0@lo:503: 00000100:00100000:3.0:1788836439.322635:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782795136:12345-0@lo:503: Request processed in 253us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.322643:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788836439.325135:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795136:0@lo:503: 00000100:00100000:0.0:1788836439.325401:0:10014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10014:1875730782795264:0@lo:502: 00000100:00100000:0.0:1788836439.325470:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.325507:0:10014:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.325658:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795264 00000100:00100000:3.0:1788836439.325664:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795264 00000100:00100000:3.0:1788836439.325719:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788836439.325728:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10014:x1875730782795264:12345-0@lo:502: 00000100:00100000:3.0:1788836439.325858:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10014:x1875730782795264:12345-0@lo:502: Request processed in 130us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.325868:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788836439.325915:0:10014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10014:1875730782795264:0@lo:502: 00000100:00100000:3.0:1788836439.325957:0:10014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10014:1875730782795392:0@lo:502: 00000100:00100000:3.0:1788836439.326089:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.326122:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795392 00000100:00100000:3.0:1788836439.326125:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795392 00000100:00100000:3.0:1788836439.326141:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788836439.326146:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10014:x1875730782795392:12345-0@lo:502: 00000100:00100000:3.0:1788836439.326204:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10014:x1875730782795392:12345-0@lo:502: Request processed in 56us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.326210:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788836439.326235:0:10014:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.326247:0:10014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10014:1875730782795392:0@lo:502: 00000040:00080000:3.0:1788836439.326264:0:10014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788836439.326432:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788836439.326450:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836439.326460:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326477:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836439.326487:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836439.326489:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf444f2000 from 6 10000000:01000000:0.0:1788836439.326492:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836439.326517:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326598:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326610:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.326623:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795520:0@lo:101: 00000100:00100000:0.0:1788836439.326653:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.326683:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.326698:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795520 00000100:00100000:0.0:1788836439.326701:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795520 00000100:00100000:0.0:1788836439.326720:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788836439.326726:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782795520:12345-0@lo:101: 00010000:00010000:0.0:1788836439.326735:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836439.326747:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40030200/0xf7b38383a6553ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553eec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326766:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40030200/0xf7b38383a6553ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553eec expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326788:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40030200/0xf7b38383a6553ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553eec expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326797:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030200, rc 0) 00000100:00100000:0.0:1788836439.326826:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782795520:12345-0@lo:101: Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.326832:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788836439.326861:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795520:0@lo:101: 00010000:00010000:0.0:1788836439.326871:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.326881:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.326922:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795648:0@lo:256: 00000100:00100000:0.0:1788836439.326951:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.326963:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.326973:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795648 00000100:00100000:0.0:1788836439.326976:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795648 00000100:00100000:0.0:1788836439.327085:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788836439.327094:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782795648:12345-0@lo:256: 20000000:01000000:0.0:1788836439.327118:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836439.327135:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836439.327138:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788836439.327207:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782795648:12345-0@lo:256: Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.327215:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788836439.327248:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795648:0@lo:256: 10000000:01000000:0.0:1788836439.327286:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836439.327291:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327301:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836439.327308:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788836439.327310:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788836439.327312:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788836439.327326:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327335:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327342:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.327353:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795776:0@lo:101: 00000100:00100000:0.0:1788836439.327378:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.327390:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.327400:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795776 00000100:00100000:0.0:1788836439.327404:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795776 00000100:00100000:0.0:1788836439.327421:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788836439.327426:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782795776:12345-0@lo:101: 00010000:00010000:0.0:1788836439.327432:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836439.327441:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553efa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327460:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553efa expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327468:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553efa expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.327474:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030400, rc 0) 00000100:00100000:0.0:1788836439.327502:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782795776:12345-0@lo:101: Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.327507:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788836439.329139:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795776:0@lo:101: 00010000:00010000:0.0:1788836439.329162:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.329175:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.329247:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795904:0@lo:501: 00000100:00100000:0.0:1788836439.329295:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.329376:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.330607:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782795904 00000100:00100000:3.0:1788836439.330618:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782795904 00000100:00100000:3.0:1788836439.330947:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788836439.330957:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782795904:12345-0@lo:501: 00000100:00100000:3.0:1788836439.331265:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782795904:12345-0@lo:501: Request processed in 309us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.331273:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788836439.331577:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782795904:0@lo:501: 00000100:00100000:1.0:1788836439.331621:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782796032:0@lo:503: 00000100:00100000:1.0:1788836439.331666:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.332266:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.332465:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796032 00000100:00100000:0.0:1788836439.332471:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796032 00000100:00100000:2.0:1788836439.332596:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836439.332606:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782796032:12345-0@lo:503: 00000100:00100000:2.0:1788836439.332716:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782796032:12345-0@lo:503: Request processed in 112us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.332723:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788836439.332960:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782796032:0@lo:503: 00000100:00100000:1.0:1788836439.333275:0:10015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10015:1875730782796160:0@lo:502: 00000100:00100000:1.0:1788836439.333317:0:10015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.333340:0:10015:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.334358:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796160 00000100:00100000:2.0:1788836439.334367:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796160 00000100:00100000:2.0:1788836439.334404:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788836439.334412:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10015:x1875730782796160:12345-0@lo:502: 00000100:00100000:2.0:1788836439.336157:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10015:x1875730782796160:12345-0@lo:502: Request processed in 1738us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.336179:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788836439.341199:0:10015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10015:1875730782796160:0@lo:502: 00000020:01000000:0.0:1788836439.341253:0:10015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836439.341262:0:10015:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788836439.341271:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836439.341274:0:10015:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788836439.341287:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836439.341292:0:10015:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:0.0:1788836439.341317:0:10015:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788836439.341321:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836439.341339:0:10015:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8adf7fb84d28) 00000020:00000080:0.0:1788836439.341363:0:10015:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788836439.341368:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836439.341469:0:10015:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788836439.341477:0:10015:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788836439.341485:0:10015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6553f0f 00010000:00080000:0.0:1788836439.341516:0:10015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade42b5e000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836439.341737:0:10015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788836439.341870:0:10015:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788836439.341883:0:10015:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788836439.342087:0:10015:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836439.342224:0:10015:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836439.342377:0:10015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788836439.342474:0:10015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788836439.344196:0:10017:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836439.344204:0:10017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788836439.349483:0:10015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836439.349498:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836439.350261:0:10015:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836439.350288:0:10015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553f16 00000100:00080000:0.0:1788836439.350300:0:10015:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836439.350306:0:10015:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ade42b5e000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836439.350343:0:10015:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428d9180 x1875730782796288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836439.350391:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782796288:0@lo:8: 00000100:00100000:1.0:1788836439.350472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.350557:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796288 00000100:00100000:3.0:1788836439.350563:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796288 00000100:00100000:3.0:1788836439.350593:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836439.350599:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875730782796288:12345-0@lo:8: 00010000:00080000:3.0:1788836439.350624:0:8407:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788836439.350646:0:8407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6553f1d 00002000:00100000:3.0:1788836439.350658:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8adf8145a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788836439.350667:0:8407:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788836439.350671:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788836439.350733:0:8407:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788836439.350937:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788836439.350956:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf8145f800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788836439.351083:0:10015:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788836439.351155:0:10015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836439.351160:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836439.351162:0:10015:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788836439.351172:0:10015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836439.351175:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836439.351176:0:10015:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836439.351179:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836439.351181:0:10015:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788836439.351203:0:10015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10015:1875730782796416:0@lo:502: 00000100:00100000:0.0:1788836439.351242:0:10015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.351258:0:10015:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf44c56f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.351492:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796416 00000100:00100000:2.0:1788836439.351496:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796416 00000100:00100000:2.0:1788836439.351541:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788836439.351549:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10015:x1875730782796416:12345-0@lo:502: 00000100:00100000:2.0:1788836439.351648:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10015:x1875730782796416:12345-0@lo:502: Request processed in 100us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.351655:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788836439.351693:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782796800:0@lo:400: 00000100:00100000:2.0:1788836439.351720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.351740:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782797312:0@lo:400: 00000100:00100000:2.0:1788836439.351760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.351778:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836439.351783:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782796928:0@lo:400: 00000100:00100000:2.0:1788836439.351807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.351823:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782797440:0@lo:400: 00000100:00100000:2.0:1788836439.351840:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.351867:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796800 00000100:00100000:2.0:1788836439.351871:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796800 00000100:00100000:2.0:1788836439.351897:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836439.351903:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782796800:12345-0@lo:400: 00000100:00100000:2.0:1788836439.351938:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782796800:12345-0@lo:400: Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.351945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836439.351961:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797312 00000100:00100000:2.0:1788836439.351964:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797312 00000100:00100000:2.0:1788836439.352036:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797440 00000100:00100000:2.0:1788836439.352039:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797440 00000100:00100000:2.0:1788836439.352058:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836439.352064:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782797312:12345-0@lo:400: 00000100:00100000:2.0:1788836439.352093:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782797312:12345-0@lo:400: Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.352112:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836439.352123:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836439.352129:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782797440:12345-0@lo:400: 00000100:00100000:2.0:1788836439.352155:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782797440:12345-0@lo:400: Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.352160:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836439.352177:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796928 00000100:00100000:2.0:1788836439.352180:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796928 00000100:00100000:2.0:1788836439.352203:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836439.352209:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782796928:12345-0@lo:400: 00000100:00100000:2.0:1788836439.352235:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782796928:12345-0@lo:400: Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.352241:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836439.352278:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782796928:0@lo:400: 00010000:00080000:2.0:1788836439.352290:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43899180 x1875730782797440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836439.352300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782797440:0@lo:400: 00010000:00080000:2.0:1788836439.352309:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43898a80 x1875730782796800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836439.352317:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782796800:0@lo:400: 00010000:00080000:2.0:1788836439.352335:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389b480 x1875730782797312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836439.352342:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782797312:0@lo:400: 00000100:00100000:0.0:1788836439.353705:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782796544:0@lo:400: 00000100:00100000:0.0:1788836439.353755:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.353783:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782797056:0@lo:400: 00000100:00100000:0.0:1788836439.353805:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.353820:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782797568:0@lo:400: 00000100:00100000:0.0:1788836439.353838:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.353856:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788836439.353862:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782796672:0@lo:400: 00000100:00100000:0.0:1788836439.353884:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.353900:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782797184:0@lo:400: 00000100:00100000:0.0:1788836439.353920:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.353929:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782797696:0@lo:400: 00000100:00100000:0.0:1788836439.353949:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.354310:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796544 00000100:00100000:0.0:1788836439.354318:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796544 00000100:00100000:0.0:1788836439.354348:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797056 00000100:00100000:0.0:1788836439.354351:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797056 00000100:00100000:0.0:1788836439.354366:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797568 00000100:00100000:0.0:1788836439.354368:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797568 00000100:00100000:0.0:1788836439.354380:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797184 00000100:00100000:0.0:1788836439.354391:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797184 00000100:00100000:0.0:1788836439.354409:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797696 00000100:00100000:0.0:1788836439.354411:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797696 00000100:00100000:0.0:1788836439.354426:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836439.354433:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782796544:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354482:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782796544:12345-0@lo:400: Request processed in 49us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354490:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836439.354506:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836439.354512:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782797056:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354611:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782797056:12345-0@lo:400: Request processed in 98us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354618:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836439.354629:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836439.354635:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782797568:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354659:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782797568:12345-0@lo:400: Request processed in 25us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354665:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836439.354675:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836439.354681:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782797184:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354706:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782797184:12345-0@lo:400: Request processed in 25us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354711:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836439.354722:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836439.354727:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782797696:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354753:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782797696:12345-0@lo:400: Request processed in 25us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354764:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836439.354784:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782796672 00000100:00100000:0.0:1788836439.354788:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782796672 00000100:00100000:0.0:1788836439.354809:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788836439.354816:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782796672:12345-0@lo:400: 00000100:00100000:0.0:1788836439.354849:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782796672:12345-0@lo:400: Request processed in 33us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836439.354855:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788836439.354889:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782796672:0@lo:400: 00010000:00080000:0.0:1788836439.354901:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389b800 x1875730782797184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.354911:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782797184:0@lo:400: 00010000:00080000:0.0:1788836439.354920:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43898000 x1875730782797696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.354928:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782797696:0@lo:400: 00010000:00080000:0.0:1788836439.354937:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4389a680 x1875730782796544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.354945:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782796544:0@lo:400: 00010000:00080000:0.0:1788836439.354954:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43899c00 x1875730782797056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.354961:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782797056:0@lo:400: 00010000:00080000:0.0:1788836439.354969:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43899500 x1875730782797568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.354988:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782797568:0@lo:400: 00000100:00100000:0.0:1788836439.355166:0:10015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10015:1875730782796416:0@lo:502: 00000020:01000000:0.0:1788836439.355200:0:10015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836439.355209:0:10015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836439.355211:0:10015:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788836439.355217:0:10015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788836439.355566:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788836439.355589:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788836439.355605:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.355616:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836439.355626:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788836439.355629:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf50b59800 from 39 10000000:01000000:1.0:1788836439.355632:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836439.355659:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.355668:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.355678:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.355695:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782797824:0@lo:101: 00000100:00100000:1.0:1788836439.355730:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.355764:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082000 going to sleep for 11 seconds 00000100:00080000:1.0:1788836439.355785:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836439.355789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836439.355792:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836439.356120:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797824 00000100:00100000:2.0:1788836439.356125:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797824 00000100:00100000:2.0:1788836439.356159:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788836439.356167:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782797824:12345-0@lo:101: 00010000:00010000:2.0:1788836439.356176:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836439.356189:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553f24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.356210:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.356219:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.356228:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47e00, rc 0) 00000100:00100000:2.0:1788836439.356259:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782797824:12345-0@lo:101: Request processed in 93us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.356265:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788836439.356300:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782797824:0@lo:101: 00010000:00010000:2.0:1788836439.356312:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836439.356320:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836439.356382:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782797952:0@lo:501: 00000100:00100000:2.0:1788836439.356406:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.356426:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.356439:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782797952 00000100:00100000:2.0:1788836439.356442:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782797952 00000100:00100000:2.0:1788836439.356462:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836439.356468:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782797952:12345-0@lo:501: 00000100:00100000:2.0:1788836439.356632:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782797952:12345-0@lo:501: Request processed in 163us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.356640:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836439.356665:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782797952:0@lo:501: 00000100:00100000:2.0:1788836439.356689:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798080:0@lo:503: 00000100:00100000:2.0:1788836439.356725:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.356737:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf442f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.356748:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798080 00000100:00100000:2.0:1788836439.356752:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798080 00000100:00100000:2.0:1788836439.356771:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788836439.356778:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782798080:12345-0@lo:503: 00000100:00100000:2.0:1788836439.356851:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782798080:12345-0@lo:503: Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.356857:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788836439.356893:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798080:0@lo:503: 00000100:00100000:3.0:1788836439.358244:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782796288:12345-0@lo:8: Request processed in 7638us (7767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.358256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788836439.360233:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428d9180 x1875730782796288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.360249:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836439.360258:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788836439.360269:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788836439.360274:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788836439.360286:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788836439.361208:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788836439.361219:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782796288:0@lo:8: 00000100:00100000:1.0:1788836439.361364:0:10021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10021:1875730782798208:0@lo:502: 00000100:00100000:1.0:1788836439.361442:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.361484:0:10021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082180 going to sleep for 11 seconds 00000004:00080000:3.0:1788836439.361538:0:10017:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788836439.361608:0:10017:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 223267595904ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788836439.361615:0:10017:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788836439.365157:0:7421:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788836439.366705:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798208 00000100:00100000:2.0:1788836439.366724:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798208 00000100:00100000:2.0:1788836439.367138:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788836439.367151:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10021:x1875730782798208:12345-0@lo:502: 00000100:00100000:2.0:1788836439.367327:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10021:x1875730782798208:12345-0@lo:502: Request processed in 179us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.367336:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788836439.367712:0:10021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10021:1875730782798208:0@lo:502: 00000100:00100000:0.0:1788836439.367779:0:10021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10021:1875730782798336:0@lo:502: 00000100:00100000:0.0:1788836439.367827:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.368097:0:10019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782798464:0@lo:700: 00000100:00100000:3.0:1788836439.368156:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.368187:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798464 00000100:00100000:3.0:1788836439.368192:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798464 00000100:00100000:3.0:1788836439.368234:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836439.368241:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10019:x1875730782798464:12345-0@lo:700: 00000100:00100000:3.0:1788836439.368279:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8415:1875730782798592:0@lo:700: 00000100:00100000:3.0:1788836439.368305:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.368323:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.368334:0:10019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf510eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.371512:0:10021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e240 going to sleep for 11 seconds 00000100:00080000:0.0:1788836439.372698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836439.373342:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798336 00000100:00100000:1.0:1788836439.373353:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798336 00000100:00100000:1.0:1788836439.373412:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788836439.373422:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10021:x1875730782798336:12345-0@lo:502: 00000100:00100000:1.0:1788836439.373711:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10021:x1875730782798336:12345-0@lo:502: Request processed in 289us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.373718:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788836439.373770:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798592 00000100:00100000:1.0:1788836439.373774:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798592 00000100:00100000:1.0:1788836439.373802:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836439.373809:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8415:x1875730782798592:12345-0@lo:700: 00000100:00100000:3.0:1788836439.373977:0:10021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10021:1875730782798336:0@lo:502: 00000040:00080000:3.0:1788836439.374050:0:10021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788836439.374170:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788836439.374193:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836439.374203:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374213:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836439.374222:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836439.374225:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adf50b59800 from 6 10000000:01000000:1.0:1788836439.374236:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836439.374265:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374273:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374282:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.374299:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798720:0@lo:101: 00000100:00100000:1.0:1788836439.374332:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.374359:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.374371:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798720 00000100:00100000:1.0:1788836439.374374:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798720 00000100:00100000:1.0:1788836439.374391:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788836439.374396:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782798720:12345-0@lo:101: 00010000:00010000:1.0:1788836439.374404:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836439.374415:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429ea400/0xf7b38383a6553f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553f32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374434:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea400/0xf7b38383a6553f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553f32 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374443:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429ea400/0xf7b38383a6553f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f32 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374452:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea400, rc 0) 00000100:00100000:1.0:1788836439.374478:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782798720:12345-0@lo:101: Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.374491:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788836439.374517:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798720:0@lo:101: 00010000:00010000:1.0:1788836439.374659:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.374669:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.374710:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798848:0@lo:256: 00000100:00100000:1.0:1788836439.374738:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.374751:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.374762:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798848 00000100:00100000:1.0:1788836439.374765:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798848 00000100:00100000:1.0:1788836439.374783:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788836439.374789:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782798848:12345-0@lo:256: 20000000:01000000:1.0:1788836439.374800:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788836439.374815:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788836439.374818:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788836439.374919:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782798848:12345-0@lo:256: Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.374926:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788836439.374954:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798848:0@lo:256: 10000000:01000000:1.0:1788836439.375090:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836439.375096:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375114:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836439.375126:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788836439.375128:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788836439.375130:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788836439.375145:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375152:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375159:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.375170:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798976:0@lo:101: 00000100:00100000:1.0:1788836439.375193:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.375207:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.375218:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782798976 00000100:00100000:1.0:1788836439.375221:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782798976 00000100:00100000:1.0:1788836439.375238:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788836439.375244:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782798976:12345-0@lo:101: 00010000:00010000:1.0:1788836439.375250:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836439.375257:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553f40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375271:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375278:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375296:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea200, rc 0) 00000100:00100000:1.0:1788836439.375325:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782798976:12345-0@lo:101: Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.375331:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788836439.375360:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782798976:0@lo:101: 00010000:00010000:1.0:1788836439.375369:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836439.375376:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836439.375422:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782799104:0@lo:501: 00000100:00100000:1.0:1788836439.375445:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.375458:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.375468:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799104 00000100:00100000:1.0:1788836439.375470:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799104 00000100:00100000:1.0:1788836439.375488:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788836439.375493:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782799104:12345-0@lo:501: 00000100:00100000:1.0:1788836439.375669:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782799104:12345-0@lo:501: Request processed in 174us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.375676:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788836439.375703:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782799104:0@lo:501: 00000100:00100000:1.0:1788836439.375729:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782799232:0@lo:503: 00000100:00100000:1.0:1788836439.375761:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.375773:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.375787:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799232 00000100:00100000:1.0:1788836439.375791:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799232 00000100:00100000:1.0:1788836439.375806:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788836439.375811:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782799232:12345-0@lo:503: 00000100:00100000:1.0:1788836439.375884:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782799232:12345-0@lo:503: Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.375891:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788836439.375927:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782799232:0@lo:503: 00000100:00100000:3.0:1788836439.377473:0:10023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10023:1875730782799360:0@lo:502: 00000100:00100000:3.0:1788836439.377593:0:10023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.377632:0:10023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.377680:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799360 00000100:00100000:2.0:1788836439.377686:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799360 00000100:00100000:2.0:1788836439.377725:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788836439.377734:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10023:x1875730782799360:12345-0@lo:502: 00000100:00100000:2.0:1788836439.377856:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10023:x1875730782799360:12345-0@lo:502: Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.377864:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788836439.377913:0:10023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10023:1875730782799360:0@lo:502: 00000020:01000000:2.0:1788836439.377939:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836439.377947:0:10023:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788836439.377954:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836439.377957:0:10023:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788836439.377961:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836439.377965:0:10023:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:2.0:1788836439.378134:0:10023:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836439.378138:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836439.378153:0:10023:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ade42540000) 00000020:00000080:2.0:1788836439.378180:0:10023:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788836439.378186:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836439.378256:0:10023:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788836439.378262:0:10023:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788836439.378269:0:10023:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6553f55 00010000:00080000:2.0:1788836439.378298:0:10023:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf77de7000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788836439.379175:0:10023:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788836439.379298:0:10023:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788836439.379310:0:10023:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788836439.379474:0:10023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836439.380788:0:10023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836439.380938:0:10023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788836439.381169:0:10023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 40000000:02000000:2.0:1788836439.382143:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:1.0:1788836439.384871:0:10024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836439.384881:0:10024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788836439.390514:0:10023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836439.390594:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788836439.390636:0:10023:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788836439.390662:0:10023:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553f5c 00000100:00080000:1.0:1788836439.390674:0:10023:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836439.390680:0:10023:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf77de7000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836439.390713:0:10023:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a756a00 x1875730782799488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836439.390741:0:10023:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788836439.390797:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836439.390801:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836439.390803:0:10023:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788836439.390806:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836439.390810:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836439.390811:0:10023:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836439.390814:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836439.390816:0:10023:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788836439.390843:0:10023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10023:1875730782799616:0@lo:502: 00000100:00100000:1.0:1788836439.390931:0:10023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.390966:0:10023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836439.391112:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782799488:0@lo:8: 00000100:00100000:0.0:1788836439.391150:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.391670:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799616 00000100:00100000:2.0:1788836439.391677:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799616 00000100:00100000:2.0:1788836439.391720:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788836439.391729:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10023:x1875730782799616:12345-0@lo:502: 00000100:00100000:2.0:1788836439.391854:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10023:x1875730782799616:12345-0@lo:502: Request processed in 126us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.391861:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788836439.391904:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799488 00000100:00100000:2.0:1788836439.391909:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799488 00000100:00100000:2.0:1788836439.391930:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836439.391935:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875730782799488:12345-0@lo:8: 00010000:00080000:2.0:1788836439.391959:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1788836439.391984:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6553f63 00002000:00100000:2.0:1788836439.392752:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adf77de4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788836439.392759:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788836439.392762:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788836439.392829:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836439.392866:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8ade4396f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836439.392928:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782799488:12345-0@lo:8: Request processed in 990us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.392943:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836439.393030:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8415:x1875730782798592:12345-0@lo:700: Request processed in 19200us (24702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.393039:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788836439.393082:0:8415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f8a80 x1875730782798592/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836439.393095:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8415:1875730782798592:0@lo:700: 40000000:02000000:2.0:1788836439.393116:0:8415:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00010000:00080000:0.0:1788836439.396562:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a756a00 x1875730782799488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.396579:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836439.396589:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788836439.396598:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836439.396604:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788836439.396607:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf77de7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836439.396627:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836439.396634:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782799488:0@lo:8: 00000004:00080000:0.0:1788836439.398468:0:10024:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836439.398565:0:10024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223304552305ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788836439.398573:0:10024:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788836439.409914:0:10026:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788836439.409946:0:10026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782799872:0@lo:7: 00000100:00100000:1.0:1788836439.410094:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836439.410118:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782799744:0@lo:13: 00000100:00100000:1.0:1788836439.410166:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788836439.410216:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788836439.410240:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799744 00000100:00100000:1.0:1788836439.410247:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799744 00000100:00100000:1.0:1788836439.410302:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836439.410312:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782799744:12345-0@lo:13: 00002000:00000024:1.0:1788836439.410338:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788836439.410380:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782799744:12345-0@lo:13: Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.410387:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788836439.410411:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788836439.410441:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f8e00 x1875730782799744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.410459:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782799744:0@lo:13: 00000100:00100000:3.0:1788836439.411195:0:10026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.411219:0:10026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.413254:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782799872 00000100:00100000:2.0:1788836439.413266:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782799872 00000100:00100000:2.0:1788836439.413315:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836439.413325:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10026:x1875730782799872:12345-0@lo:7: 00000100:00100000:3.0:1788836439.415218:0:10023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10023:1875730782799616:0@lo:502: 00000020:01000000:3.0:1788836439.415260:0:10023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836439.415268:0:10023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836439.415270:0:10023:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788836439.415274:0:10023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1788836439.415441:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788836439.415466:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788836439.415477:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.415489:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836439.415500:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788836439.415503:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adf48a1cd28 from 1 10000000:01000000:0.0:1788836439.415506:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788836439.415538:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.415546:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.415554:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.415572:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782800000:0@lo:101: 00000100:00100000:0.0:1788836439.415627:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.415671:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.415716:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800000 00000100:00100000:3.0:1788836439.415722:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800000 00000100:00100000:3.0:1788836439.415769:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788836439.415778:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782800000:12345-0@lo:101: 00010000:00010000:3.0:1788836439.415792:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836439.415804:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553f6a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.415826:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.415837:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.415846:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836439.415881:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782800000:12345-0@lo:101: Request processed in 104us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.415888:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788836439.415954:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782800000:0@lo:101: 00010000:00010000:0.0:1788836439.415966:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.415975:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836439.416069:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782800128:0@lo:501: 00000100:00100000:0.0:1788836439.416095:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.416122:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.416222:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800128 00000100:00100000:3.0:1788836439.416226:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800128 00000100:00100000:3.0:1788836439.416263:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788836439.416270:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782800128:12345-0@lo:501: 00000100:00100000:3.0:1788836439.416339:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782800128:12345-0@lo:501: Request processed in 69us (242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836439.416346:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788836439.416408:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782800128:0@lo:501: 10000000:01000000:0.0:1788836439.416431:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788836439.416437:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836439.416444:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836439.423177:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788836439.423578:0:8498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788836439.423585:0:8498:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788836439.423721:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10026:x1875730782799872:12345-0@lo:7: Request processed in 10394us (12524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.423732:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00100000:2.0:1788836439.426398:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788836439.426409:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788836439.426530:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782798464:12345-0@lo:700: Request processed in 58283us (58368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836439.426547:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788836439.426827:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f8000 x1875730782799872/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836439.426843:0:10026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782799872:0@lo:7: 00000004:00080000:3.0:1788836439.426858:0:10026:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00010000:00080000:3.0:1788836439.426887:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f9180 x1875730782798464/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836439.426898:0:10019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782798464:0@lo:700: 00000100:00100000:3.0:1788836439.427367:0:10026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782800256:0@lo:5: 00000100:00100000:3.0:1788836439.427403:0:10026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.427466:0:10026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.427570:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800256 00000100:00100000:2.0:1788836439.427577:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800256 00000100:00100000:2.0:1788836439.427651:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836439.427660:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10026:x1875730782800256:12345-0@lo:5: 00002000:00080000:2.0:1788836439.427714:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788836439.427718:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788836439.428089:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10026:x1875730782800256:12345-0@lo:5: Request processed in 429us (684us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788836439.428105:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788836439.428177:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f9180 x1875730782800256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.428191:0:10026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782800256:0@lo:5: 00000004:00080000:1.0:1788836439.428212:0:10026:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788836439.428247:0:10026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782800384:0@lo:700: 00000100:00100000:1.0:1788836439.428273:0:10026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.428294:0:10026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.429166:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800384 00000100:00100000:1.0:1788836439.429264:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800384 00000100:00100000:1.0:1788836439.429316:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836439.429324:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10026:x1875730782800384:12345-0@lo:700: 00000001:00080000:1.0:1788836439.435421:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788836439.435741:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10026:x1875730782800384:12345-0@lo:700: Request processed in 6413us (7460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.435753:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788836439.435886:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a755880 x1875730782800384/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.435897:0:10026:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788836439.435926:0:10026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782800384:0@lo:700: 00000004:00080000:3.0:1788836439.437028:0:10019:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788836439.437069:0:10019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800640:0@lo:7: 00000100:00100000:3.0:1788836439.437130:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.437143:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836439.437161:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782800512:0@lo:13: 00000100:00100000:3.0:1788836439.437170:0:10019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf461116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.437190:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800640 00000100:00100000:2.0:1788836439.437202:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836439.437209:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800640 00000100:00100000:3.0:1788836439.437271:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836439.437289:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782800640:12345-0@lo:7: 00000100:00100000:1.0:1788836439.438224:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800512 00000100:00100000:1.0:1788836439.438233:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800512 00000100:00100000:1.0:1788836439.438272:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836439.438280:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875730782800512:12345-0@lo:13: 00002000:00000024:1.0:1788836439.438296:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788836439.438357:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875730782800512:12345-0@lo:13: Request processed in 78us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.438363:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788836439.438402:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f9500 x1875730782800512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.438421:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782800512:0@lo:13: 00000004:02000040:1.0:1788836439.440763:0:10026:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:3.0:1788836439.449816:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788836439.449825:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788836439.449922:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782800640:12345-0@lo:7: Request processed in 12631us (12788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.449933:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788836439.451084:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f9180 x1875730782800640/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836439.451128:0:10019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800640:0@lo:7: 00000004:00080000:2.0:1788836439.451143:0:10019:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788836439.451184:0:10019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800768:0@lo:5: 00000100:00100000:2.0:1788836439.451229:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836439.451260:0:10019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf47c34240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.451476:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800768 00000100:00100000:3.0:1788836439.451484:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800768 00000100:00100000:3.0:1788836439.451534:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836439.451544:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782800768:12345-0@lo:5: 00002000:00080000:3.0:1788836439.451569:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788836439.451617:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782800768:12345-0@lo:5: Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836439.451623:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788836439.451668:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43898a80 x1875730782800768/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.451680:0:10019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800768:0@lo:5: 00000004:00080000:0.0:1788836439.451689:0:10019:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788836439.451713:0:10019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800896:0@lo:5: 00000100:00100000:0.0:1788836439.451737:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.451765:0:10019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836439.451804:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782800896 00000100:00100000:2.0:1788836439.451809:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782800896 00000100:00100000:2.0:1788836439.451843:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836439.451851:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10019:x1875730782800896:12345-0@lo:5: 00002000:00080000:2.0:1788836439.451875:0:8408:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788836439.452414:0:10026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782801024:0@lo:5: 00000100:00100000:1.0:1788836439.452450:0:10026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836439.452482:0:10026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836439.452492:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801024 00000100:00100000:3.0:1788836439.452497:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801024 00000100:00100000:3.0:1788836439.452571:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836439.452580:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10026:x1875730782801024:12345-0@lo:5: 00002000:00080000:3.0:1788836439.458243:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788836439.458262:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788836439.458467:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10019:x1875730782800896:12345-0@lo:5: Request processed in 6612us (6724us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788836439.458477:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788836439.459467:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428da680 x1875730782800896/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.459487:0:10019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10019:1875730782800896:0@lo:5: 00000004:00080000:0.0:1788836439.459503:0:10019:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788836439.459608:0:10019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10019:1875730782801152:0@lo:900: 00000100:00100000:0.0:1788836439.459657:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836439.459692:0:10019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836439.459730:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801152 00000100:00100000:1.0:1788836439.459739:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801152 00000100:00100000:1.0:1788836439.459836:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836439.459853:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10019:x1875730782801152:12345-0@lo:900: 00000100:00100000:1.0:1788836439.459904:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10019:x1875730782801152:12345-0@lo:900: Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836439.459924:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788836439.460506:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428d8700 x1875730782801152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836439.460521:0:10019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10019:1875730782801152:0@lo:900: 00000100:00100000:3.0:1788836439.461107:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10026:x1875730782801024:12345-0@lo:5: Request processed in 8517us (8645us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788836439.461118:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788836439.462425:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a755880 x1875730782801024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836439.462443:0:10026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10026:1875730782801024:0@lo:5: 00000004:00080000:1.0:1788836439.462455:0:10026:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1788836440.102430:0:10057:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836440.102443:0:10057:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788836440.447178:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836440.589380:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.589535:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770165888 00000100:00100000:0.0:1788836440.589547:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770165888 00000100:00100000:0.0:1788836440.589598:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:0.0:1788836440.589607:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1875730770165888:12345-192.168.201.38@tcp:250: 00010000:00080000:0.0:1788836440.589637:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e3ffaddc-7971-40cd-b532-959b315f8e2b@192.168.201.38@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788836440.589670:0:6483:0:(genops.c:1385:class_connect()) connect: client e3ffaddc-7971-40cd-b532-959b315f8e2b, cookie 0xf7b38383a6553f78 00000100:00080000:0.0:1788836440.589839:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836440.589914:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+5:2393:x1875730770165888:12345-192.168.201.38@tcp:250: Request processed in 305us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.589922:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:2.0:1788836440.617442:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.617629:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166016 00000100:00100000:0.0:1788836440.617641:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166016 00000100:00100000:0.0:1788836440.617737:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:0.0:1788836440.617749:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+5:6157:x1875730770166016:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1788836440.617767:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836440.617787:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa139 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.617817:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.617829:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.617852:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82172c00, rc 0) 00000100:00100000:0.0:1788836440.617912:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+6:6157:x1875730770166016:12345-192.168.201.38@tcp:101: Request processed in 165us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.617919:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:1.0:1788836440.634181:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836440.634275:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166144 00000100:00100000:3.0:1788836440.634287:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166144 00000100:00100000:3.0:1788836440.634347:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:3.0:1788836440.634367:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+6:6157:x1875730770166144:12345-192.168.201.38@tcp:501: 00000100:00100000:3.0:1788836440.634518:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+6:6157:x1875730770166144:12345-192.168.201.38@tcp:501: Request processed in 161us (347us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836440.634526:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:3.0:1788836440.637785:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.640170:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166272 00000100:00100000:0.0:1788836440.640183:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166272 00000100:00100000:0.0:1788836440.640253:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:0.0:1788836440.640262:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+6:6157:x1875730770166272:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1788836440.640278:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836440.640293:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa140 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.640316:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.640327:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.640335:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173600, rc 0) 00000100:00100000:0.0:1788836440.640404:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+7:6157:x1875730770166272:12345-192.168.201.38@tcp:101: Request processed in 142us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.640411:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:0.0:1788836440.644839:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836440.645007:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166400 00000100:00100000:2.0:1788836440.645036:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166400 00000100:00100000:2.0:1788836440.645156:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:2.0:1788836440.645167:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+7:6157:x1875730770166400:12345-192.168.201.38@tcp:501: 00000100:00100000:2.0:1788836440.645471:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6157:x1875730770166400:12345-192.168.201.38@tcp:501: Request processed in 305us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836440.645488:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:1.0:1788836440.649843:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836440.649927:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166528 00000100:00100000:3.0:1788836440.649937:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166528 00000100:00100000:3.0:1788836440.650146:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:3.0:1788836440.650158:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6157:x1875730770166528:12345-192.168.201.38@tcp:503: 00000100:00100000:3.0:1788836440.650332:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6157:x1875730770166528:12345-192.168.201.38@tcp:503: Request processed in 176us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836440.650386:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:3.0:1788836440.655688:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836440.656152:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166656 00000100:00100000:2.0:1788836440.656165:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166656 00000100:00100000:2.0:1788836440.656220:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:2.0:1788836440.656230:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6176:x1875730770166656:12345-192.168.201.38@tcp:502: 00000100:00100000:2.0:1788836440.656553:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6176:x1875730770166656:12345-192.168.201.38@tcp:502: Request processed in 304us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836440.656561:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:2.0:1788836440.697165:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.697420:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166784 00000100:00100000:0.0:1788836440.697432:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166784 00000100:00100000:0.0:1788836440.697693:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:0.0:1788836440.697723:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6176:x1875730770166784:12345-192.168.201.38@tcp:502: 00000100:00100000:0.0:1788836440.697930:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6176:x1875730770166784:12345-192.168.201.38@tcp:502: Request processed in 227us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.697938:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:1.0:1788836440.722967:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836440.723250:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770166912 00000100:00100000:3.0:1788836440.723259:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770166912 00000100:00100000:3.0:1788836440.723318:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:3.0:1788836440.723329:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6157:x1875730770166912:12345-192.168.201.38@tcp:101: 00010000:00010000:3.0:1788836440.723345:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836440.723375:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700600/0xf7b38383a6553f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa171 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836440.723416:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700600/0xf7b38383a6553f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa171 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836440.723429:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700600/0xf7b38383a6553f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa171 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836440.723439:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700600, rc 0) 00000100:00100000:3.0:1788836440.723528:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6157:x1875730770166912:12345-192.168.201.38@tcp:101: Request processed in 192us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836440.723536:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:3.0:1788836440.733947:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836440.734223:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167040 00000100:00100000:2.0:1788836440.734234:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167040 00000100:00100000:2.0:1788836440.734290:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788836440.734301:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6157:x1875730770167040:12345-192.168.201.38@tcp:256: 20000000:01000000:2.0:1788836440.734331:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788836440.734358:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788836440.734361:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788836440.734364:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788836440.734367:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788836440.734369:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788836440.741180:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6157:x1875730770167040:12345-192.168.201.38@tcp:256: Request processed in 6869us (7229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.741194:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:1.0:1788836440.747298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.747405:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167168 00000100:00100000:0.0:1788836440.747416:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167168 00000100:00100000:0.0:1788836440.747703:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:0.0:1788836440.747713:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6157:x1875730770167168:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1788836440.747729:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836440.747746:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa178 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.747773:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.747784:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836440.747792:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:0.0:1788836440.747847:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6157:x1875730770167168:12345-192.168.201.38@tcp:101: Request processed in 136us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.747854:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:3.0:1788836440.750326:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.751750:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167296 00000100:00100000:0.0:1788836440.751763:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167296 00000100:00100000:0.0:1788836440.751838:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:0.0:1788836440.751848:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6157:x1875730770167296:12345-192.168.201.38@tcp:501: 00000100:00100000:0.0:1788836440.752337:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6157:x1875730770167296:12345-192.168.201.38@tcp:501: Request processed in 489us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.752346:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:2.0:1788836440.755348:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836440.755801:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167424 00000100:00100000:3.0:1788836440.755811:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167424 00000100:00100000:3.0:1788836440.755877:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:3.0:1788836440.755889:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6157:x1875730770167424:12345-192.168.201.38@tcp:503: 00000100:00100000:3.0:1788836440.756194:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6157:x1875730770167424:12345-192.168.201.38@tcp:503: Request processed in 306us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836440.756202:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:1.0:1788836440.764144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.764299:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167552 00000100:00100000:0.0:1788836440.764319:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167552 00000100:00100000:0.0:1788836440.764385:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:0.0:1788836440.764397:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6182:x1875730770167552:12345-192.168.201.38@tcp:502: 00000100:00100000:0.0:1788836440.764840:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6182:x1875730770167552:12345-192.168.201.38@tcp:502: Request processed in 443us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.764849:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:2.0:1788836440.776378:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.776647:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167680 00000100:00100000:0.0:1788836440.776658:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167680 00000100:00100000:0.0:1788836440.776719:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:0.0:1788836440.776730:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6182:x1875730770167680:12345-192.168.201.38@tcp:502: 00000100:00100000:0.0:1788836440.777746:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6182:x1875730770167680:12345-192.168.201.38@tcp:502: Request processed in 1013us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.777757:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:2.0:1788836440.791987:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836440.792203:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167808 00000100:00100000:0.0:1788836440.792214:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167808 00000100:00100000:0.0:1788836440.792263:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788836440.792272:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875730770167808:12345-192.168.201.38@tcp:38: 00010000:00080000:0.0:1788836440.792306:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788836440.792365:0:6492:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a6553f9b 00000004:00100000:0.0:1788836440.792393:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788836440.792745:0:6492:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836440.793045:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770167808:12345-192.168.201.38@tcp:38: Request processed in 771us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836440.793054:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836440.797614:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836440.797846:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168064 00000100:00100000:2.0:1788836440.797866:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168064 00000100:00100000:2.0:1788836440.797914:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1788836440.797922:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875730770168064:12345-192.168.201.38@tcp:38: 00010000:00080000:2.0:1788836440.797952:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1788836440.798028:0:6491:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a6553fa2 00000004:00100000:2.0:1788836440.798053:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788836440.798258:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8ade4396b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836440.798327:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770168064:12345-192.168.201.38@tcp:38: Request processed in 404us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836440.798334:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:3.0:1788836441.470347:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836441.806890:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836441.806932:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836441.807082:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168320 00000100:00100000:3.0:1788836441.807093:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168320 00000100:00100000:3.0:1788836441.807159:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770167936 00000100:00100000:3.0:1788836441.807162:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770167936 00000100:00100000:3.0:1788836441.807179:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788836441.807188:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:6157:x1875730770168320:12345-192.168.201.38@tcp:41: 00000004:00000024:3.0:1788836441.807223:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788836441.807280:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:6157:x1875730770168320:12345-192.168.201.38@tcp:41: Request processed in 93us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836441.807286:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788836441.807302:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788836441.807307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770167936:12345-192.168.201.38@tcp:41: 00000004:00000024:3.0:1788836441.807316:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788836441.807350:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770167936:12345-192.168.201.38@tcp:41: Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836441.807355:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00080000:1.0:1788836441.807911:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836441.808086:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836441.808131:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168192 00000100:00100000:3.0:1788836441.808136:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168192 00000100:00100000:3.0:1788836441.808194:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:3.0:1788836441.808204:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770168192:12345-192.168.201.38@tcp:41: 00000004:00000024:3.0:1788836441.808229:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836441.808284:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770168192:12345-192.168.201.38@tcp:41: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836441.808291:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:0.0:1788836441.808350:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836441.812738:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836441.812839:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168448 00000100:00100000:0.0:1788836441.812849:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168448 00000100:00100000:0.0:1788836441.812905:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788836441.812915:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770168448:12345-192.168.201.38@tcp:40: 00000100:00100000:0.0:1788836441.813006:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770168448:12345-192.168.201.38@tcp:40: Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836441.813049:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788836441.816745:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836441.816793:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836441.816872:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168576 00000100:00100000:3.0:1788836441.816882:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168576 00000100:00100000:3.0:1788836441.816923:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168704 00000100:00100000:3.0:1788836441.816927:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168704 00000100:00100000:3.0:1788836441.816964:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788836441.816972:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875730770168576:12345-192.168.201.38@tcp:8: 00010000:00080000:3.0:1788836441.817006:0:8498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1788836441.817078:0:8498:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a6553fa9 00002000:00100000:3.0:1788836441.817091:0:8498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b8fbf20-a55f-40bb-87b6-19e878cca24b/ffff8adf81459000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836441.817109:0:8498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836441.817299:0:8498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836441.817327:0:8498:0:(import.c:65:import_set_state_nolock()) ffff8adf81458000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836441.817386:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770168576:12345-192.168.201.38@tcp:8: Request processed in 413us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836441.817402:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788836441.817419:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1788836441.817424:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875730770168704:12345-192.168.201.38@tcp:8: 00010000:00080000:3.0:1788836441.817440:0:8498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1788836441.817456:0:8498:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a6553fb0 00002000:00100000:3.0:1788836441.817461:0:8498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b8fbf20-a55f-40bb-87b6-19e878cca24b/ffff8adf8145d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836441.817472:0:8498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836441.817713:0:8498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836441.817729:0:8498:0:(import.c:65:import_set_state_nolock()) ffff8ade42528800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836441.817752:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770168704:12345-192.168.201.38@tcp:8: Request processed in 327us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836441.817760:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788836441.823044:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836441.823192:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168832 00000100:00100000:0.0:1788836441.823202:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168832 00000100:00100000:0.0:1788836441.823263:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1788836441.823273:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770168832:12345-192.168.201.38@tcp:900: 00000100:00100000:0.0:1788836441.823362:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770168832:12345-192.168.201.38@tcp:900: Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836441.823370:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788836441.824472:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836441.824808:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836441.825050:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169088 00000100:00100000:1.0:1788836441.825069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169088 00000100:00100000:1.0:1788836441.825120:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788836441.825130:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770169088:12345-192.168.201.38@tcp:33: 00000100:00100000:0.0:1788836441.830097:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770168960 00000100:00100000:0.0:1788836441.830111:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770168960 00000100:00100000:0.0:1788836441.830176:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:0.0:1788836441.830187:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770168960:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1788836441.830256:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770168960:12345-192.168.201.38@tcp:400: Request processed in 71us (5788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836441.830263:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000004:00080000:2.0:1788836441.853341:0:6493:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28134us 00000100:00100000:0.0:1788836441.855157:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836441.855186:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782801280:0@lo:41: 00000100:00100000:0.0:1788836441.855249:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836441.855316:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801280 00000100:00100000:0.0:1788836441.855323:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801280 00000100:00100000:0.0:1788836441.855367:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788836441.855375:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782801280:12345-0@lo:41: 00000004:00000024:0.0:1788836441.855402:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836441.855444:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782801280:12345-0@lo:41: Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836441.855451:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788836441.855512:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782801280:0@lo:41: 00000004:00200000:1.0:1788836441.877113:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788836441.877215:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6157:x1875730770169088:12345-192.168.201.38@tcp:33: Request processed in 52081us (52402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836441.877225:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1788836442.072800:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836442.073002:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169216 00000100:00100000:2.0:1788836442.073049:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169216 00000100:00100000:2.0:1788836442.073133:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1788836442.073144:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6200:x1875730770169216:12345-192.168.201.38@tcp:101: 00010000:00010000:2.0:1788836442.073181:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836442.073215:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47200/0xf7b38383a6553fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1a9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073300:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073317:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073366:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836442.073426:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836442.073430:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836442.073448:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073491:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47200/0xf7b38383a6553fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1a9 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073513:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1a9 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836442.073524:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836442.073527:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836442.073531:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46000, rc 0) 00000100:00100000:2.0:1788836442.073608:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:6200:x1875730770169216:12345-192.168.201.38@tcp:101: Request processed in 466us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836442.073617:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00010000:00010000:1.0:1788836442.494287:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836442.878616:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836442.878648:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782801408:0@lo:13: 00000100:00100000:2.0:1788836442.878708:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782801536:0@lo:13: 00000100:00100000:1.0:1788836442.878731:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836442.878804:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836442.878846:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801408 00000100:00100000:1.0:1788836442.878858:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801408 00000100:00100000:2.0:1788836442.878891:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801536 00000100:00100000:2.0:1788836442.878901:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801536 00000100:00100000:1.0:1788836442.878926:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836442.878939:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782801408:12345-0@lo:13: 00002000:00000024:1.0:1788836442.878962:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836442.879032:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782801408:12345-0@lo:13: Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836442.879051:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788836442.879077:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836442.879107:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7736bb80 x1875730782801408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836442.879125:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782801408:0@lo:13: 00000100:00100000:2.0:1788836442.879444:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836442.879456:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782801536:12345-0@lo:13: 00002000:00000024:2.0:1788836442.879479:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836442.879550:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782801536:12345-0@lo:13: Request processed in 96us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836442.879557:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788836442.879598:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43898000 x1875730782801536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836442.879617:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782801536:0@lo:13: 00010000:00010000:3.0:1788836443.519530:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836443.903989:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782801664:0@lo:41: 00000100:00100000:1.0:1788836443.904113:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836443.904276:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801664 00000100:00100000:3.0:1788836443.904292:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801664 00000100:00100000:3.0:1788836443.904376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836443.904389:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782801664:12345-0@lo:41: 00000004:00000024:3.0:1788836443.905544:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788836443.905725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782801664:12345-0@lo:41: Request processed in 1335us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836443.905750:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836443.912509:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782801664:0@lo:41: 00000100:00100000:2.0:1788836444.323362:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836444.323460:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169344 00000100:00100000:3.0:1788836444.323483:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169344 00000100:00100000:3.0:1788836444.323564:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788836444.323575:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:6253:x1875730770169344:12345-192.168.201.38@tcp:41: 00000004:00000024:3.0:1788836444.323610:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788836444.323683:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:6253:x1875730770169344:12345-192.168.201.38@tcp:41: Request processed in 110us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836444.323691:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00080000:1.0:1788836444.324288:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836444.327709:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836444.327815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169472 00000100:00100000:2.0:1788836444.327826:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169472 00000100:00100000:2.0:1788836444.328060:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836444.328075:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169472:12345-192.168.201.38@tcp:41: 00000004:00000024:2.0:1788836444.328115:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836444.328234:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169472:12345-192.168.201.38@tcp:41: Request processed in 162us (535us total) trans 0 rc 0/0 00000100:00080000:1.0:1788836444.328279:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836444.331689:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836444.332347:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836444.332535:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169600 00000100:00100000:0.0:1788836444.332544:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169600 00000100:00100000:0.0:1788836444.332658:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1788836444.332668:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169600:12345-192.168.201.38@tcp:13: 00002000:00000024:0.0:1788836444.332701:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836444.332766:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169600:12345-192.168.201.38@tcp:13: Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.332773:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00080000:1.0:1788836444.334390:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836444.335279:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836444.335368:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169728 00000100:00100000:2.0:1788836444.335378:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169728 00000100:00100000:2.0:1788836444.335451:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788836444.335462:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169728:12345-192.168.201.38@tcp:13: 00002000:00000024:2.0:1788836444.335493:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836444.335550:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:6253:x1875730770169728:12345-192.168.201.38@tcp:13: Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836444.335558:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00080000:1.0:1788836444.335698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836444.414395:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782801792:0@lo:13: 00000100:00100000:1.0:1788836444.414487:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836444.416395:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801792 00000100:00100000:2.0:1788836444.416408:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801792 00000100:00100000:0.0:1788836444.417366:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782801920:0@lo:400: 00000100:00100000:0.0:1788836444.417433:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417483:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782802432:0@lo:400: 00000100:00100000:0.0:1788836444.417511:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417542:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782802944:0@lo:400: 00000100:00100000:0.0:1788836444.417567:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417593:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788836444.417600:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782802304:0@lo:400: 00000100:00100000:0.0:1788836444.417624:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417641:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782802816:0@lo:400: 00000100:00100000:0.0:1788836444.417661:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417676:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782803328:0@lo:400: 00000100:00100000:0.0:1788836444.417695:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.417724:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802432 00000100:00100000:0.0:1788836444.417729:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802432 00000100:00100000:0.0:1788836444.417773:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836444.417781:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782802432:12345-0@lo:400: 00000100:00100000:0.0:1788836444.417834:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782802432:12345-0@lo:400: Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.417842:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836444.417866:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802944 00000100:00100000:0.0:1788836444.417869:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802944 00000100:00100000:0.0:1788836444.417900:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802816 00000100:00100000:0.0:1788836444.417915:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802816 00000100:00100000:0.0:1788836444.417930:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803328 00000100:00100000:0.0:1788836444.417933:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803328 00000100:00100000:0.0:1788836444.417947:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836444.417954:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782802944:12345-0@lo:400: 00000100:00100000:0.0:1788836444.417985:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782802944:12345-0@lo:400: Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.417991:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836444.418003:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836444.418052:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782802816:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418082:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782802816:12345-0@lo:400: Request processed in 32us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418088:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836444.418099:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836444.418104:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3615:x1875730782803328:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418128:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3615:x1875730782803328:12345-0@lo:400: Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418134:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836444.418165:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802304 00000100:00100000:0.0:1788836444.418168:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802304 00000100:00100000:0.0:1788836444.418190:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788836444.418196:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782802304:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418226:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782802304:12345-0@lo:400: Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418232:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788836444.418248:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836444.418253:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836444.418262:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782802048:0@lo:400: 00000100:00100000:0.0:1788836444.418288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418308:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782802560:0@lo:400: 00000100:00100000:0.0:1788836444.418328:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418343:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782803072:0@lo:400: 00000100:00100000:0.0:1788836444.418362:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418374:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836444.418379:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782802176:0@lo:400: 00000100:00100000:0.0:1788836444.418411:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782802688:0@lo:400: 00000100:00100000:0.0:1788836444.418446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418456:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782803200:0@lo:400: 00000100:00100000:0.0:1788836444.418474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.418491:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802048 00000100:00100000:0.0:1788836444.418495:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802048 00000100:00100000:0.0:1788836444.418510:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802560 00000100:00100000:0.0:1788836444.418512:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802560 00000100:00100000:0.0:1788836444.418529:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803072 00000100:00100000:0.0:1788836444.418532:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803072 00000100:00100000:0.0:1788836444.418540:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802688 00000100:00100000:0.0:1788836444.418542:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802688 00000100:00100000:0.0:1788836444.418551:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803200 00000100:00100000:0.0:1788836444.418553:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803200 00000100:00100000:0.0:1788836444.418565:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836444.418570:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782802048:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418603:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782802048:12345-0@lo:400: Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418609:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836444.418621:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836444.418626:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782802560:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418654:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782802560:12345-0@lo:400: Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418659:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836444.418671:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836444.418677:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782803072:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418701:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782803072:12345-0@lo:400: Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418713:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836444.418726:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836444.418731:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782802688:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418778:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782802688:12345-0@lo:400: Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418783:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836444.418796:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836444.418801:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782803200:12345-0@lo:400: 00000100:00100000:0.0:1788836444.418826:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782803200:12345-0@lo:400: Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.418832:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788836444.418849:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836444.418852:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836444.418881:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782802304:0@lo:400: 00010000:00080000:0.0:1788836444.418894:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155ca80 x1875730782802816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836444.418903:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782802816:0@lo:400: 00010000:00080000:0.0:1788836444.418913:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155f480 x1875730782803328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836444.418920:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782803328:0@lo:400: 00000100:00100000:0.0:1788836444.418930:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782802432:0@lo:400: 00010000:00080000:0.0:1788836444.418938:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155fb80 x1875730782802944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836444.418944:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782802944:0@lo:400: 00010000:00080000:0.0:1788836444.418984:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155c380 x1875730782802688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836444.418993:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782802688:0@lo:400: 00010000:00080000:0.0:1788836444.419002:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155f800 x1875730782803200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836444.419008:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782803200:0@lo:400: 00000100:00100000:0.0:1788836444.419051:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782802048:0@lo:400: 00000100:00100000:0.0:1788836444.419060:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782802560:0@lo:400: 00000100:00100000:0.0:1788836444.419068:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782803072:0@lo:400: 00000100:00100000:3.0:1788836444.419260:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782801920 00000100:00100000:3.0:1788836444.419266:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782801920 00000100:00100000:3.0:1788836444.419303:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788836444.419310:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782801920:12345-0@lo:400: 00000100:00100000:3.0:1788836444.419356:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782801920:12345-0@lo:400: Request processed in 46us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836444.419363:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788836444.419390:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782802176 00000100:00100000:3.0:1788836444.419393:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782802176 00000100:00100000:3.0:1788836444.419416:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836444.419422:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782802176:12345-0@lo:400: 00000100:00100000:3.0:1788836444.419458:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782802176:12345-0@lo:400: Request processed in 36us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836444.419465:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836444.419489:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782801920:0@lo:400: 00000100:00100000:3.0:1788836444.419515:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782802176:0@lo:400: 00000100:00100000:2.0:1788836444.421341:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836444.421363:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782801792:12345-0@lo:13: 00002000:00000024:2.0:1788836444.421387:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836444.421484:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782801792:12345-0@lo:13: Request processed in 126us (6988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836444.421491:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788836444.421517:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7736bb80 x1875730782801792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836444.421557:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782801792:0@lo:13: 00000100:00080000:1.0:1788836444.422002:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836444.544524:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836444.927137:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836444.927164:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782803456:0@lo:13: 00000100:00100000:3.0:1788836444.927235:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836444.927469:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803456 00000100:00100000:0.0:1788836444.927477:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803456 00000100:00100000:0.0:1788836444.927535:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836444.927545:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875730782803456:12345-0@lo:13: 00002000:00000024:0.0:1788836444.927568:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836444.927623:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875730782803456:12345-0@lo:13: Request processed in 80us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836444.927631:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788836444.927746:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817bad80 x1875730782803456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836444.927766:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782803456:0@lo:13: 00000001:00100000:1.0:1788836444.931887:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000001:00080000:1.0:1788836444.933429:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788836444.933443:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788836445.569177:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836445.955082:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00010000:00010000:3.0:1788836446.590705:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836446.734072:0:10155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788836446.977608:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000100:00100000:3.0:1788836446.978701:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782803584:0@lo:41: 00000100:00100000:3.0:1788836446.978792:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836446.979663:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803584 00000100:00100000:1.0:1788836446.979672:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803584 00000100:00100000:1.0:1788836446.979717:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788836446.979727:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782803584:12345-0@lo:41: 00000004:00000024:1.0:1788836446.979761:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836446.979809:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782803584:12345-0@lo:41: Request processed in 84us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836446.979816:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836446.980486:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782803584:0@lo:41: 00000100:00100000:3.0:1788836447.167416:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836447.167470:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836447.167496:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169984 00000100:00100000:0.0:1788836447.167506:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169984 00000100:00100000:3.0:1788836447.167514:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836447.167540:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836447.167562:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170112 00000100:00100000:3.0:1788836447.167565:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836447.167565:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170112 00000100:00100000:0.0:1788836447.167584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1788836447.167590:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788836447.167593:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770169984:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1788836447.167597:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770170112:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1788836447.167667:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770170112:12345-192.168.201.38@tcp:400: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836447.167675:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788836447.167720:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170240 00000100:00100000:3.0:1788836447.167724:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170240 00000100:00100000:3.0:1788836447.167750:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170368 00000100:00100000:3.0:1788836447.167752:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170368 00000100:00100000:3.0:1788836447.167770:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788836447.167777:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770170240:12345-192.168.201.38@tcp:400: 00000100:00100000:1.0:1788836447.167847:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788836447.167857:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770170368:12345-192.168.201.38@tcp:400: 00000100:00100000:2.0:1788836447.167918:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770169856 00000100:00100000:2.0:1788836447.167923:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770169856 00000100:00100000:2.0:1788836447.167959:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:2.0:1788836447.167993:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770169856:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1788836447.171087:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770169984:12345-192.168.201.38@tcp:400: Request processed in 3483us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836447.171115:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00080000:0.0:1788836447.171173:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836447.171178:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836447.171181:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836447.171183:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836447.174616:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770170368:12345-192.168.201.38@tcp:400: Request processed in 6749us (7037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836447.174632:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788836447.174792:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770170240:12345-192.168.201.38@tcp:400: Request processed in 7014us (7319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836447.174800:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836447.180350:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770169856:12345-192.168.201.38@tcp:400: Request processed in 12158us (12608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836447.180365:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00010000:00010000:3.0:1788836447.614341:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836447.998431:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782803712:0@lo:13: 00000100:00100000:1.0:1788836447.998580:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836447.998592:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782803840:0@lo:13: 00000100:00100000:0.0:1788836447.999852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836447.999937:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803712 00000100:00100000:1.0:1788836447.999945:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803712 00000100:00100000:1.0:1788836448.000028:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836448.000038:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782803712:12345-0@lo:13: 00002000:00000024:1.0:1788836448.000070:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836448.000175:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836448.000217:0:8410:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788836448.000228:0:8410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788836448.001727:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803840 00000100:00100000:2.0:1788836448.001736:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803840 00000100:00100000:3.0:1788836448.001887:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788836448.001898:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782803840:12345-0@lo:13: 00002000:00000024:3.0:1788836448.001919:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836448.002005:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782803840:12345-0@lo:13: Request processed in 109us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836448.002036:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788836448.002236:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155d180 x1875730782803840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836448.002258:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782803840:0@lo:13: 00000100:00100000:1.0:1788836448.002876:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782803712:12345-0@lo:13: Request processed in 2837us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836448.002886:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000001:00100000:2.0:1788836448.004761:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00010000:00080000:0.0:1788836448.008433:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5180 x1875730782803712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836448.008462:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782803712:0@lo:13: 00000100:00080000:0.0:1788836448.008502:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836448.640467:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836449.022601:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836449.022628:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782803968:0@lo:41: 00000100:00100000:3.0:1788836449.022715:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836449.023184:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782803968 00000100:00100000:1.0:1788836449.023194:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782803968 00000100:00100000:1.0:1788836449.023292:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788836449.023310:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782803968:12345-0@lo:41: 00000004:00000024:1.0:1788836449.023346:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788836449.023414:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782803968:12345-0@lo:41: Request processed in 106us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.023557:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788836449.030112:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782803968:0@lo:41: 00000100:00100000:3.0:1788836449.535476:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782804096:0@lo:400: 00000100:00100000:2.0:1788836449.535499:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782804480:0@lo:400: 00000100:00100000:3.0:1788836449.540989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541086:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782804608:0@lo:400: 00000100:00100000:3.0:1788836449.541132:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541155:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805120:0@lo:400: 00000100:00100000:3.0:1788836449.541176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541193:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805632:0@lo:400: 00000100:00100000:3.0:1788836449.541210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541234:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788836449.541241:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782804224:0@lo:400: 00000100:00100000:3.0:1788836449.541273:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541292:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782804736:0@lo:400: 00000100:00100000:3.0:1788836449.541310:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541326:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782805248:0@lo:400: 00000100:00100000:3.0:1788836449.541344:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541378:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805760:0@lo:13: 00000100:00100000:3.0:1788836449.541398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541433:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782804352:0@lo:400: 00000100:00100000:3.0:1788836449.541456:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541474:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782804864:0@lo:400: 00000100:00100000:3.0:1788836449.541494:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541504:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782805376:0@lo:400: 00000100:00100000:3.0:1788836449.541525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.541552:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804608 00000100:00100000:3.0:1788836449.541560:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804608 00000100:00100000:3.0:1788836449.541598:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804352 00000100:00100000:3.0:1788836449.541601:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804352 00000100:00100000:3.0:1788836449.541616:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836449.541624:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782804608:12345-0@lo:400: 00000100:00100000:3.0:1788836449.541683:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782804608:12345-0@lo:400: Request processed in 58us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.541690:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836449.541705:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788836449.541711:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782804352:12345-0@lo:400: 00000100:00100000:3.0:1788836449.541742:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782804352:12345-0@lo:400: Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.541767:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788836449.541786:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805120 00000100:00100000:3.0:1788836449.541789:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805120 00000100:00100000:3.0:1788836449.541831:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805632 00000100:00100000:3.0:1788836449.541834:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805632 00000100:00100000:3.0:1788836449.541855:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836449.541861:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805120:12345-0@lo:400: 00000100:00100000:3.0:1788836449.541893:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805120:12345-0@lo:400: Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.541899:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836449.541911:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836449.541916:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805632:12345-0@lo:400: 00000100:00100000:3.0:1788836449.541955:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805632:12345-0@lo:400: Request processed in 38us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.541960:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836449.541979:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804224 00000100:00100000:3.0:1788836449.541982:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804224 00000100:00100000:3.0:1788836449.541996:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804736 00000100:00100000:3.0:1788836449.541998:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804736 00000100:00100000:3.0:1788836449.542009:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805248 00000100:00100000:3.0:1788836449.542031:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805248 00000100:00100000:3.0:1788836449.542044:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804864 00000100:00100000:3.0:1788836449.542047:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804864 00000100:00100000:3.0:1788836449.542056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805376 00000100:00100000:3.0:1788836449.542058:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805376 00000100:00100000:3.0:1788836449.542069:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836449.542074:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782804224:12345-0@lo:400: 00000100:00100000:3.0:1788836449.542102:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782804224:12345-0@lo:400: Request processed in 28us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.542115:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836449.542127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836449.542132:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782804736:12345-0@lo:400: 00000100:00100000:3.0:1788836449.542160:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782804736:12345-0@lo:400: Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.542165:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836449.542175:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836449.542181:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782805248:12345-0@lo:400: 00000100:00100000:3.0:1788836449.542207:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782805248:12345-0@lo:400: Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.542213:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836449.542224:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836449.542229:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782804864:12345-0@lo:400: 00000100:00100000:3.0:1788836449.542252:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782804864:12345-0@lo:400: Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.542256:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836449.542266:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836449.542270:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782805376:12345-0@lo:400: 00000100:00100000:3.0:1788836449.542295:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782805376:12345-0@lo:400: Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.542300:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788836449.542325:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836449.542329:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836449.542331:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836449.542333:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836449.542361:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782804352:0@lo:400: 00010000:00080000:3.0:1788836449.542382:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5f80 x1875730782804864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836449.542392:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782804864:0@lo:400: 00010000:00080000:3.0:1788836449.542401:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5500 x1875730782805376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836449.542408:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782805376:0@lo:400: 00000100:00100000:3.0:1788836449.542441:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782804224:0@lo:400: 00000100:00100000:3.0:1788836449.542451:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782804736:0@lo:400: 00000100:00100000:3.0:1788836449.542460:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782805248:0@lo:400: 00000100:00100000:3.0:1788836449.542470:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782804608:0@lo:400: 00010000:00080000:3.0:1788836449.542479:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6300 x1875730782805120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836449.542488:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805120:0@lo:400: 00010000:00080000:3.0:1788836449.542497:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43862300 x1875730782805632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836449.542504:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788836449.542513:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805632:0@lo:400: 00000100:00100000:1.0:1788836449.542609:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804096 00000100:00100000:1.0:1788836449.542614:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804096 00000100:00100000:1.0:1788836449.542652:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788836449.542658:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782804096:12345-0@lo:400: 00000100:00100000:1.0:1788836449.542700:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782804096:12345-0@lo:400: Request processed in 41us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.542707:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788836449.542749:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782804096:0@lo:400: 00000100:00100000:0.0:1788836449.543193:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805760 00000100:00100000:0.0:1788836449.543199:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805760 00000100:00100000:0.0:1788836449.543226:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836449.543233:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805760:12345-0@lo:13: 00002000:00000024:0.0:1788836449.543256:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836449.543295:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782805760:12345-0@lo:13: Request processed in 62us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836449.543301:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788836449.544527:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155d880 x1875730782805760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836449.544547:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782805760:0@lo:13: 00000100:00100000:2.0:1788836449.545185:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836449.545229:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782804992:0@lo:400: 00000100:00100000:2.0:1788836449.545268:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836449.545302:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804992 00000100:00100000:2.0:1788836449.545308:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804992 00000100:00100000:2.0:1788836449.545342:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836449.546749:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782804992:12345-0@lo:400: 00000100:00100000:2.0:1788836449.546834:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782804992:12345-0@lo:400: Request processed in 1483us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836449.546843:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788836449.547115:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c7100 x1875730782804992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836449.547129:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782804992:0@lo:400: 00000100:00100000:2.0:1788836449.547140:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782805504:0@lo:400: 00000100:00100000:2.0:1788836449.547183:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836449.547545:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782804480 00000100:00100000:0.0:1788836449.547552:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782804480 00000100:00100000:0.0:1788836449.547589:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836449.547596:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782804480:12345-0@lo:400: 00000100:00100000:0.0:1788836449.547636:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782804480:12345-0@lo:400: Request processed in 41us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836449.547642:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836449.547977:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782804480:0@lo:400: 00000100:00100000:3.0:1788836449.549061:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782805504 00000100:00100000:3.0:1788836449.549070:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782805504 00000100:00100000:3.0:1788836449.549128:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788836449.549137:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782805504:12345-0@lo:400: 00000100:00100000:3.0:1788836449.549206:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782805504:12345-0@lo:400: Request processed in 71us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.549220:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788836449.549245:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788836449.549523:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5180 x1875730782805504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836449.549534:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788836449.549550:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782805504:0@lo:400: 00010000:00010000:3.0:1788836449.662638:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836449.809783:0:10303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8d8b2e10 20000000:00000080:1.0:1788836449.809799:0:10303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ade42b39c00 uarg=0000000000000000 20000000:01000000:1.0:1788836449.809841:0:10303:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788836449.809843:0:10303:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788836449.809845:0:10303:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788836449.809850:0:10303:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788836449.809856:0:10303:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788836449.810145:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788836449.810148:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788836449.810669:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788836449.811430:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788836449.811465:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788836449.811482:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788836449.811494:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788836449.811496:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788836449.811838:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788836449.812314:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788836449.812337:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788836449.812354:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788836449.812365:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788836449.812366:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788836449.812626:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788836449.812777:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788836449.812809:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788836449.812825:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788836449.812835:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788836449.812837:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788836449.813304:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788836449.813459:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788836449.813480:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788836449.813493:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788836449.813502:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788836449.813504:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788836449.813741:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788836449.813880:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788836449.813897:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788836449.813987:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1788836449.814003:0:10303:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788836449.814168:0:10303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814187:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814196:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814204:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814210:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814217:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ede expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814223:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553efa expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814235:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814243:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814249:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814259:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814266:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814273:0:10303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814309:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814324:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 9 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.814338:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782805888:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836449.814482:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814491:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 9 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.814506:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806016:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836449.814534:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814542:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 23 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.814551:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806144:0@lo:104: 00000100:00100000:1.0:1788836449.814587:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836449.814623:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814631:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 23 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.814639:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806272:0@lo:104: 00000100:00100000:1.0:1788836449.814669:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836449.814728:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.814737:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 23 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.814745:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806400:0@lo:104: 00000100:00100000:1.0:1788836449.814762:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836449.815472:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.815492:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 23 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.815508:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806528:0@lo:104: 00000100:00100000:1.0:1788836449.815539:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.815557:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806144 00000100:00100000:3.0:1788836449.815564:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806144 00000100:00100000:3.0:1788836449.815601:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806272 00000100:00100000:3.0:1788836449.815603:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806272 00000100:00100000:3.0:1788836449.815613:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806400 00000100:00100000:3.0:1788836449.815615:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806400 00000100:00100000:3.0:1788836449.815626:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836449.815633:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10303:x1875730782806144:12345-0@lo:104: 00010000:00010000:3.0:1788836449.815644:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815695:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836449.815701:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10303:x1875730782806144:12345-0@lo:104: Request processed in 69us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.815708:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836449.815724:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836449.815729:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782806272:12345-0@lo:104: 00010000:00010000:3.0:1788836449.815736:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815779:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836449.815784:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782806272:12345-0@lo:104: Request processed in 55us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.815790:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836449.815802:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836449.815808:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782806400:12345-0@lo:104: 00010000:00010000:3.0:1788836449.815815:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815839:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788836449.815844:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782806400:12345-0@lo:104: Request processed in 37us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.815850:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788836449.815870:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788836449.815877:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815884:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836449.815888:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815896:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836449.815904:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836449.815931:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836449.815966:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815973:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836449.815990:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.815997:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40031400/0xf7b38383a6553f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f71 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816008:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836449.816037:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816043:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836449.816046:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816053:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836449.816059:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836449.816064:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836449.816077:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816083:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836449.816089:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816105:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a6553f40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f47 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816115:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836449.816118:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816123:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836449.816126:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816132:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836449.816139:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836449.816143:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836449.816158:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816163:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836449.816176:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816182:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429ea800/0xf7b38383a6553f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f2b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.816190:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.816197:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.816199:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836449.816213:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782806656:0@lo:103: 00000100:00100000:3.0:1788836449.816247:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.816270:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836449.816276:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782806784:0@lo:103: 00000100:00100000:3.0:1788836449.816297:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.816319:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836449.816326:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782806912:0@lo:103: 00000100:00100000:3.0:1788836449.816345:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836449.816989:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806656 00000100:00100000:0.0:1788836449.816997:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806656 00010000:00010000:0.0:1788836449.817052:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 24 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836449.817070:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806784 00000100:00100000:0.0:1788836449.817073:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806784 00010000:00010000:0.0:1788836449.817084:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 25 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836449.817094:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806912 00000100:00100000:0.0:1788836449.817097:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806912 00010000:00010000:0.0:1788836449.817106:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 26 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836449.817118:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836449.817124:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3614:x1875730782806656:12345-0@lo:103: 00010000:00010000:0.0:1788836449.817135:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836449.817140:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 26 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817150:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 26 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817181:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836449.817228:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3614:x1875730782806656:12345-0@lo:103: Request processed in 103us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836449.817235:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836449.817275:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836449.817281:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782806784:12345-0@lo:103: 00010000:00010000:0.0:1788836449.817289:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836449.817293:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 25 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817301:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 25 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817310:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836449.817330:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782806784:12345-0@lo:103: Request processed in 49us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836449.817335:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836449.817353:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836449.817359:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782806912:12345-0@lo:103: 00010000:00010000:0.0:1788836449.817365:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836449.817369:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 24 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817377:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 24 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836449.817386:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836449.817422:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782806912:12345-0@lo:103: Request processed in 63us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836449.817428:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836449.817461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782806912:0@lo:103: 00000100:00100000:3.0:1788836449.817892:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782806784:0@lo:103: 00000100:00100000:3.0:1788836449.817912:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782806656:0@lo:103: 00000100:00100000:0.0:1788836449.819191:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836449.819275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836449.819325:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170496 00000100:00100000:3.0:1788836449.819333:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170496 00010000:00010000:3.0:1788836449.819366:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 10 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836449.819387:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170624 00000100:00100000:3.0:1788836449.819390:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170624 00010000:00010000:3.0:1788836449.819401:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 11 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836449.819416:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836449.819434:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:2395:x1875730770170496:12345-192.168.201.38@tcp:103: 00010000:00010000:3.0:1788836449.819448:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836449.819454:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 11 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.819481:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 11 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.819539:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836449.819593:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:2395:x1875730770170496:12345-192.168.201.38@tcp:103: Request processed in 169us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.819601:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836449.819618:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1788836449.819625:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770170624:12345-192.168.201.38@tcp:103: 00010000:00010000:3.0:1788836449.819633:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836449.819637:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 10 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.819647:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 10 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.819656:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836449.819674:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770170624:12345-192.168.201.38@tcp:103: Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.819679:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00010000:00010000:2.0:1788836449.819999:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836449.820190:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.820202:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 23 pid: 6483 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820215:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807040:0@lo:104: 00010000:00010000:1.0:1788836449.820253:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.820261:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 23 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820269:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807168:0@lo:104: 00010000:00010000:1.0:1788836449.820301:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.820309:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 23 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820316:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807296:0@lo:104: 00010000:00010000:1.0:1788836449.820338:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.820359:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 23 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820367:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807424:0@lo:104: 00010000:00010000:1.0:1788836449.820409:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.820416:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 23 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820430:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807552:0@lo:104: 00000100:00100000:1.0:1788836449.820450:0:10303:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad600 going to sleep for 11 seconds 00010000:00010000:1.0:1788836449.820473:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82173600/0xf7b38383a6553f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa140 expref: 9 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820487:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782805888:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836449.820499:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82172c00/0xf7b38383a6553f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa139 expref: 8 pid: 6484 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820508:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806016:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836449.820519:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700400/0xf7b38383a6553f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553f6a expref: 23 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820526:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806144:0@lo:104: 00010000:00010000:1.0:1788836449.820535:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429ea200/0xf7b38383a6553f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553f40 expref: 22 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820556:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806272:0@lo:104: 00010000:00010000:1.0:1788836449.820570:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47e00/0xf7b38383a6553f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553f24 expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.820577:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806400:0@lo:104: 00000100:00100000:3.0:1788836449.820693:0:7432:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788836449.820715:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.820736:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.820822:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.820899:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836449.821046:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782806528 00000100:00100000:1.0:1788836449.821052:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782806528 00000100:00100000:1.0:1788836449.821082:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807040 00000100:00100000:1.0:1788836449.821085:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807040 00000100:00100000:1.0:1788836449.821105:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807168 00000100:00100000:1.0:1788836449.821108:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807168 00000100:00100000:1.0:1788836449.821115:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807296 00000100:00100000:1.0:1788836449.821117:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807296 00000100:00100000:1.0:1788836449.821128:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836449.821135:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a717c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:10303:x1875730782806528:12345-0@lo:104: 00010000:00010000:1.0:1788836449.821146:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.821192:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836449.821198:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a717c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:10303:x1875730782806528:12345-0@lo:104: Request processed in 64us (5659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.821204:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836449.821238:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836449.821244:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10303:x1875730782807040:12345-0@lo:104: 00010000:00010000:1.0:1788836449.821251:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.821292:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836449.821297:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10303:x1875730782807040:12345-0@lo:104: Request processed in 53us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.821303:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836449.821316:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836449.821322:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782807168:12345-0@lo:104: 00010000:00010000:1.0:1788836449.821328:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.821353:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788836449.821358:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782807168:12345-0@lo:104: Request processed in 38us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.821363:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836449.821374:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836449.821379:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782807296:12345-0@lo:104: 00010000:00010000:1.0:1788836449.821386:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836449.821410:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788836449.821416:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782807296:12345-0@lo:104: Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836449.821421:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836449.821452:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782806528:0@lo:104: 00000100:00100000:1.0:1788836449.821460:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807040:0@lo:104: 00000100:00100000:1.0:1788836449.821466:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807168:0@lo:104: 00000100:00100000:1.0:1788836449.821482:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807296:0@lo:104: 00010000:00010000:2.0:1788836449.821543:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788836449.821550:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821557:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836449.821567:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821576:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836449.821583:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836449.821589:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836449.821627:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821634:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836449.821653:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821659:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030000/0xf7b38383a6553efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553f01 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821670:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836449.821674:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821679:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836449.821682:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821688:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836449.821705:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836449.821710:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836449.821725:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821730:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836449.821744:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821750:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030a00/0xf7b38383a6553ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ee5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821759:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836449.821762:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821767:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836449.821769:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821775:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836449.821780:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836449.821786:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836449.821806:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821813:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836449.821819:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821825:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40031800/0xf7b38383a6553ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ed7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821836:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836449.821839:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821843:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836449.821846:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821851:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836449.821857:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836449.821862:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836449.821874:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821880:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836449.821885:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821901:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429eb800/0xf7b38383a6553ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553ec9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.821997:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836449.821999:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836449.822001:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836449.822035:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782807936:0@lo:103: 00000100:00100000:2.0:1788836449.822071:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836449.822104:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836449.822110:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782807808:0@lo:103: 00000100:00100000:2.0:1788836449.822130:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836449.822156:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807936 00000100:00100000:2.0:1788836449.822161:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807936 00010000:00010000:2.0:1788836449.822180:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836449.822198:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807808 00000100:00100000:2.0:1788836449.822201:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807808 00010000:00010000:2.0:1788836449.822211:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 22 pid: 6483 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836449.822223:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836449.822229:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3615:x1875730782807936:12345-0@lo:103: 00010000:00010000:2.0:1788836449.822240:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836449.822244:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 22 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822254:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 22 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822275:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ed0 expref: 22 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822287:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836449.822317:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3615:x1875730782807936:12345-0@lo:103: Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836449.822324:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836449.822338:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836449.822344:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3615:x1875730782807808:12345-0@lo:103: 00010000:00010000:2.0:1788836449.822351:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836449.822356:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 20 pid: 6483 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822363:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 20 pid: 6483 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822373:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700800/0xf7b38383a6553ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ede expref: 20 pid: 6483 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.822381:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836449.822401:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3615:x1875730782807808:12345-0@lo:103: Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836449.822407:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836449.822434:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782807808:0@lo:103: 00000100:00100000:2.0:1788836449.822442:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782807936:0@lo:103: 00000100:00100000:3.0:1788836449.822641:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.822650:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807424 00000100:00100000:3.0:1788836449.822659:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807424 00000100:00100000:3.0:1788836449.822678:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807552 00000100:00100000:3.0:1788836449.822681:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807552 00000100:00100000:3.0:1788836449.822692:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836449.822697:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782807424:12345-0@lo:104: 00010000:00010000:3.0:1788836449.822705:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.822751:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836449.822757:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10303:x1875730782807424:12345-0@lo:104: Request processed in 59us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.822762:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836449.822775:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836449.822780:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782807552:12345-0@lo:104: 00010000:00010000:3.0:1788836449.822787:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.822812:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836449.822816:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10303:x1875730782807552:12345-0@lo:104: Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.822822:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788836449.822836:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836449.822841:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.822848:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836449.822851:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.822868:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836449.822873:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836449.822879:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836449.822901:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.823069:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782807680:0@lo:103: 00000100:00100000:1.0:1788836449.823101:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836449.823127:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836449.823133:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782808064:0@lo:103: 00000100:00100000:1.0:1788836449.823153:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836449.823250:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836449.823427:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788836449.823465:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782808192:0@lo:103: 00000100:00100000:1.0:1788836449.823491:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836449.823536:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782807680 00000100:00100000:2.0:1788836449.823546:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782807680 00010000:00010000:2.0:1788836449.823565:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 19 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836449.823580:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808064 00000100:00100000:2.0:1788836449.823582:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808064 00010000:00010000:2.0:1788836449.823592:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 20 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836449.823601:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808192 00000100:00100000:2.0:1788836449.823604:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808192 00010000:00010000:2.0:1788836449.823612:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836449.823624:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836449.823630:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3617:x1875730782807680:12345-0@lo:103: 00010000:00010000:2.0:1788836449.823652:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836449.823658:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.823668:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.823679:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40030400/0xf7b38383a6553f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553efa expref: 21 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836449.823689:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836449.823729:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.823736:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030600/0xf7b38383a6553e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e8a expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.823746:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.823747:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.823749:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836449.823883:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3617:x1875730782807680:12345-0@lo:103: Request processed in 252us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836449.823891:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836449.824061:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836449.824069:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3617:x1875730782808064:12345-0@lo:103: 00010000:00010000:3.0:1788836449.824077:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836449.824082:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 19 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824090:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 19 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824109:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40031600/0xf7b38383a6553ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ec2 expref: 19 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824118:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836449.824142:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:3617:x1875730782808064:12345-0@lo:103: Request processed in 75us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.824147:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836449.824159:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836449.824165:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3617:x1875730782808192:12345-0@lo:103: 00010000:00010000:3.0:1788836449.824171:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836449.824174:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 17 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824181:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 17 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824189:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836449.824205:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:3617:x1875730782808192:12345-0@lo:103: Request processed in 41us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.824210:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788836449.824245:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700200/0xf7b38383a6553e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553e83 expref: 16 pid: 6485 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836449.824255:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807424:0@lo:104: 00000100:00100000:3.0:1788836449.824264:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875730782807552:0@lo:104: 00010000:00010000:3.0:1788836449.824305:0:10303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836449.824509:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782807680:0@lo:103: 00000100:00100000:1.0:1788836449.824522:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782808192:0@lo:103: 00000100:00100000:1.0:1788836449.824529:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782808064:0@lo:103: 00010000:00010000:1.0:1788836449.824587:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836449.824590:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836449.824592:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.824646:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824655:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eac00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836449.824658:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824666:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836449.824672:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836449.824677:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836449.824710:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824716:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836449.824742:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824749:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6553e59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e60 expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.824768:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.824770:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836449.824772:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836449.824820:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782808320:0@lo:103: 00000100:00100000:0.0:1788836449.824855:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836449.825001:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808320 00000100:00100000:3.0:1788836449.825006:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808320 00010000:00010000:3.0:1788836449.825054:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836449.825085:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836449.825091:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:3614:x1875730782808320:12345-0@lo:103: 00010000:00010000:3.0:1788836449.825098:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836449.825102:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825109:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825120:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eb200/0xf7b38383a6553e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553e59 expref: 16 pid: 6484 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825132:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825140:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825152:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825158:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825165:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825170:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825184:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836449.825188:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825195:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825208:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825218:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836449.825247:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:3614:x1875730782808320:12345-0@lo:103: Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836449.825254:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1788836449.825276:0:10303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825283:0:10303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836449.825289:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993400/0xf7b38383a6553fc5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836449.827083:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782808320:0@lo:103: 00000100:00100000:1.0:1788836450.050212:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836450.050236:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782808448:0@lo:13: 00000100:00100000:1.0:1788836450.050294:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836450.050395:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808448 00000100:00100000:0.0:1788836450.050404:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808448 00000100:00100000:0.0:1788836450.050459:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836450.050468:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782808448:12345-0@lo:13: 00002000:00000024:0.0:1788836450.050488:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836450.050530:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782808448:12345-0@lo:13: Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836450.050534:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788836450.050594:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebf100 x1875730782808448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836450.050610:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782808448:0@lo:13: 00010000:00010000:3.0:1788836450.686195:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836451.710947:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788836451.774301:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788836451.774315:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf7fbb1000 from 48 10000000:01000000:1.0:1788836451.774321:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836451.774372:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.774384:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.774415:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836451.774439:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808576:0@lo:101: 00000100:00100000:1.0:1788836451.774511:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836451.774591:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.774833:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808576 00000100:00100000:2.0:1788836451.774847:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808576 00000100:00100000:2.0:1788836451.774912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788836451.774921:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+15:6487:x1875730782808576:12345-0@lo:101: 00010000:00010000:2.0:1788836451.774935:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836451.774950:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553fcc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.774972:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553fcc expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.774982:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553fcc expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.774991:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47400, rc 0) 00000100:00100000:2.0:1788836451.775064:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782808576:12345-0@lo:101: Request processed in 144us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.775070:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788836451.775404:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808576:0@lo:101: 00010000:00010000:3.0:1788836451.775429:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.775440:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.775509:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808704:0@lo:501: 00000100:00100000:3.0:1788836451.775750:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.775791:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.775861:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808704 00000100:00100000:0.0:1788836451.775868:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808704 00000100:00100000:0.0:1788836451.775916:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788836451.775924:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782808704:12345-0@lo:501: 00000100:00100000:0.0:1788836451.776081:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782808704:12345-0@lo:501: Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.776088:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788836451.776337:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808704:0@lo:501: 00000100:00100000:3.0:1788836451.776378:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808832:0@lo:503: 00000100:00100000:3.0:1788836451.776420:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.776452:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.776620:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808832 00000100:00100000:1.0:1788836451.776625:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808832 00000100:00100000:1.0:1788836451.776663:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788836451.776671:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782808832:12345-0@lo:503: 00000100:00100000:1.0:1788836451.776771:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782808832:12345-0@lo:503: Request processed in 100us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.776778:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788836451.776917:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782808832:0@lo:503: 00000100:00100000:3.0:1788836451.777378:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10322:1875730782808960:0@lo:502: 00000100:00100000:3.0:1788836451.777416:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.777449:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.777506:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782808960 00000100:00100000:2.0:1788836451.777510:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782808960 00000100:00100000:2.0:1788836451.777541:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788836451.777548:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10322:x1875730782808960:12345-0@lo:502: 00000100:00100000:2.0:1788836451.777646:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10322:x1875730782808960:12345-0@lo:502: Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.777653:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788836451.777757:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10322:1875730782808960:0@lo:502: 00000100:00100000:3.0:1788836451.777789:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10322:1875730782809088:0@lo:502: 00000100:00100000:3.0:1788836451.777816:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.777875:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.782315:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836451.787185:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809088 00000100:00100000:0.0:1788836451.787200:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809088 00000100:00100000:0.0:1788836451.787264:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170752 00000100:00100000:0.0:1788836451.787287:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170752 00000100:00100000:0.0:1788836451.787308:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788836451.787319:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10322:x1875730782809088:12345-0@lo:502: 00000100:00100000:0.0:1788836451.787487:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:10322:x1875730782809088:12345-0@lo:502: Request processed in 169us (9668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.787495:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788836451.787537:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:0.0:1788836451.787545:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:6171:x1875730770170752:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1788836451.787555:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836451.787572:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f6c00/0xf7b38383a6553fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1b0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.787596:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f6c00/0xf7b38383a6553fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b0 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.787608:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f6c00/0xf7b38383a6553fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b0 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.787617:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6c00, rc 0) 00000100:00100000:0.0:1788836451.787663:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770170752:12345-192.168.201.38@tcp:101: Request processed in 119us (5359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.787670:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:3.0:1788836451.789435:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10322:1875730782809088:0@lo:502: 00000040:00080000:3.0:1788836451.789483:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788836451.789707:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788836451.789743:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836451.789755:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.789765:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836451.789775:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788836451.789778:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788836451.789781:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836451.789817:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.789838:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.789847:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836451.789866:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809216:0@lo:101: 00000100:00100000:1.0:1788836451.789935:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836451.789979:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.791439:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836451.791841:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809216 00000100:00100000:1.0:1788836451.791850:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809216 00000100:00100000:1.0:1788836451.791897:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770170880 00000100:00100000:1.0:1788836451.791901:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770170880 00000100:00100000:1.0:1788836451.791917:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788836451.791925:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+16:6487:x1875730782809216:12345-0@lo:101: 00010000:00010000:1.0:1788836451.791940:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836451.791956:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992600/0xf7b38383a6553fe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553fe1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.791982:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992600/0xf7b38383a6553fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553fe1 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.791993:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992600/0xf7b38383a6553fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553fe1 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.792002:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992600, rc 0) 00000100:00100000:1.0:1788836451.792087:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809216:12345-0@lo:101: Request processed in 163us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.792104:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788836451.792132:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:1.0:1788836451.792140:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770170880:12345-192.168.201.38@tcp:501: 00000100:00100000:1.0:1788836451.792259:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770170880:12345-192.168.201.38@tcp:501: Request processed in 119us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.792266:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:3.0:1788836451.792768:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809216:0@lo:101: 00010000:00010000:3.0:1788836451.792793:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.792803:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.792873:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809344:0@lo:501: 00000100:00100000:3.0:1788836451.792920:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.792959:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.793592:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809344 00000100:00100000:1.0:1788836451.793600:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809344 00000100:00100000:1.0:1788836451.793646:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788836451.793654:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809344:12345-0@lo:501: 00000100:00100000:1.0:1788836451.793788:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809344:12345-0@lo:501: Request processed in 135us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.793795:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788836451.793928:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809344:0@lo:501: 00000100:00100000:3.0:1788836451.793961:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809472:0@lo:503: 00000100:00100000:3.0:1788836451.794005:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.794064:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.794187:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809472 00000100:00100000:0.0:1788836451.794192:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809472 00000100:00100000:0.0:1788836451.794214:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788836451.794221:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809472:12345-0@lo:503: 00000100:00100000:0.0:1788836451.794322:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809472:12345-0@lo:503: Request processed in 100us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.794335:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788836451.796487:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809472:0@lo:503: 00000100:00100000:2.0:1788836451.798662:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10323:1875730782809600:0@lo:502: 00000100:00100000:2.0:1788836451.798752:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.798794:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.799546:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836451.799639:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809600 00000100:00100000:1.0:1788836451.799648:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809600 00000100:00100000:1.0:1788836451.799690:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171008 00000100:00100000:1.0:1788836451.799692:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171008 00000100:00100000:1.0:1788836451.799703:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788836451.799711:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10323:x1875730782809600:12345-0@lo:502: 00000100:00100000:1.0:1788836451.799829:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10323:x1875730782809600:12345-0@lo:502: Request processed in 118us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.799834:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788836451.800050:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:1.0:1788836451.800058:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770171008:12345-192.168.201.38@tcp:503: 00000100:00100000:1.0:1788836451.800129:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770171008:12345-192.168.201.38@tcp:503: Request processed in 72us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.800142:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:3.0:1788836451.800905:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10323:1875730782809600:0@lo:502: 00000020:01000000:3.0:1788836451.800934:0:10323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836451.800943:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836451.800945:0:10323:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788836451.800948:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788836451.800974:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10323:1875730782809728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.801006:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.801236:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809728 00000100:00100000:0.0:1788836451.801242:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809728 00000100:00100000:3.0:1788836451.801260:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.801286:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788836451.801295:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10323:x1875730782809728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.801393:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:10323:x1875730782809728:12345-0@lo:502:llog_process_th.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.801401:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788836451.801407:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10323:1875730782809728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836451.801427:0:10323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836451.801432:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836451.801433:0:10323:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788836451.801442:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788836451.801623:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788836451.801647:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788836451.801657:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.801668:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836451.801682:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788836451.801685:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf7a54e000 from 48 10000000:01000000:1.0:1788836451.801687:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836451.801713:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.801721:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.801729:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836451.801743:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836451.801846:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836451.802115:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.802124:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809856 00000100:00100000:0.0:1788836451.802129:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809856 00000100:00100000:3.0:1788836451.802219:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788836451.802228:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+17:6487:x1875730782809856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836451.802238:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836451.802251:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701600/0xf7b38383a6553ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553fef expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.802274:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701600/0xf7b38383a6553ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553fef expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.802284:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701600/0xf7b38383a6553ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553fef expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.802291:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701600, rc 0) 00000100:00100000:3.0:1788836451.802345:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782809856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.802351:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788836451.802482:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836451.802496:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.802504:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836451.802572:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.802600:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.802631:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.802678:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782809984 00000100:00100000:3.0:1788836451.802683:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782809984 00000100:00100000:3.0:1788836451.802717:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788836451.802723:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782809984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.802833:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782809984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.802840:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788836451.802914:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.802940:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.802978:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.802997:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.803160:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810112 00000100:00100000:3.0:1788836451.803165:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810112 00000100:00100000:3.0:1788836451.803186:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788836451.803191:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782810112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.803271:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782810112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.803277:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788836451.803570:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.804146:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10324:1875730782810240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.804191:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.804224:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.804272:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810240 00000100:00100000:3.0:1788836451.804278:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810240 00000100:00100000:3.0:1788836451.804379:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788836451.804388:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10324:x1875730782810240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.804485:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10324:x1875730782810240:12345-0@lo:502:llog_process_th.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.804492:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788836451.804773:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10324:1875730782810240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.804849:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10324:1875730782810368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.804894:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.804909:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.805085:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810368 00000100:00100000:3.0:1788836451.805090:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810368 00000100:00100000:3.0:1788836451.805112:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788836451.805118:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10324:x1875730782810368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.805188:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:10324:x1875730782810368:12345-0@lo:502:llog_process_th.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.805195:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788836451.805967:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10324:1875730782810368:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788836451.805993:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788836451.809492:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788836451.809529:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836451.809698:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.809710:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836451.809722:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788836451.809725:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788836451.809747:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836451.809803:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.809812:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.809822:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.809850:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.809931:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.809983:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.811275:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810496 00000100:00100000:0.0:1788836451.811286:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810496 00000100:00100000:0.0:1788836451.811355:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788836451.811365:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+18:6487:x1875730782810496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836451.811380:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836451.811395:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f7e00/0xf7b38383a6554004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6553ffd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.811420:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f7e00/0xf7b38383a6554004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6553ffd expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.811431:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f7e00/0xf7b38383a6554004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ffd expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.811440:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7e00, rc 0) 00000100:00100000:0.0:1788836451.811514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782810496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.811522:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788836451.811659:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836451.811676:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.811686:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836451.811755:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.811788:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.811812:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810624 00000100:00100000:3.0:1788836451.811817:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810624 00000100:00100000:2.0:1788836451.811825:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.811853:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788836451.811860:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782810624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.813340:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782810624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1472us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.813352:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788836451.816501:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.816577:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.816828:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.816923:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.822354:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810752 00000100:00100000:1.0:1788836451.822372:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810752 00000100:00100000:1.0:1788836451.822503:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788836451.822515:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782810752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836451.822741:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782810752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (5913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.822750:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788836451.822841:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.823115:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10325:1875730782810880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.823163:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.823742:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.823810:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782810880 00000100:00100000:0.0:1788836451.823816:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782810880 00000100:00100000:0.0:1788836451.823846:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788836451.823854:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:10325:x1875730782810880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.824039:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:10325:x1875730782810880:12345-0@lo:502:llog_process_th.0 Request processed in 184us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.824046:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788836451.824186:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836451.824207:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171136 00000100:00100000:0.0:1788836451.824211:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171136 00000100:00100000:0.0:1788836451.824234:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:0.0:1788836451.824239:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6653:x1875730770171136:12345-192.168.201.38@tcp:502: 00000100:00100000:0.0:1788836451.824323:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6653:x1875730770171136:12345-192.168.201.38@tcp:502: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.824330:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:2.0:1788836451.825551:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10325:1875730782810880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836451.825735:0:10325:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836451.825748:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836451.825751:0:10325:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836451.825757:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836451.825800:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10325:1875730782811008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.825871:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.825923:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.828101:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811008 00000100:00100000:0.0:1788836451.828117:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811008 00000100:00100000:0.0:1788836451.828187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788836451.828196:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:10325:x1875730782811008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.828353:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:10325:x1875730782811008:12345-0@lo:502:llog_process_th.0 Request processed in 157us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.828360:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788836451.829085:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10325:1875730782811008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836451.829124:0:10325:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836451.829133:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836451.829135:0:10325:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788836451.829139:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788836451.829519:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788836451.829539:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788836451.829550:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.829882:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:0.0:1788836451.830044:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836451.830054:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788836451.830057:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf444f2000 from 48 10000000:01000000:0.0:1788836451.830061:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836451.830094:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.830102:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.830112:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836451.830132:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.830172:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.830412:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.835377:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171264 00000100:00100000:1.0:1788836451.835393:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171264 00000100:00100000:1.0:1788836451.835443:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811136 00000100:00100000:1.0:1788836451.835446:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811136 00000100:00100000:1.0:1788836451.835473:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:1.0:1788836451.835483:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6653:x1875730770171264:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836451.835650:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6653:x1875730770171264:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 168us (5771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.835658:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:1.0:1788836451.835684:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788836451.835690:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:6487:x1875730782811136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836451.835698:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836451.835714:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992800/0xf7b38383a6554012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655400b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.835737:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992800/0xf7b38383a6554012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655400b expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.835748:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992800/0xf7b38383a6554012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655400b expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.835756:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992800, rc 0) 00000100:00100000:1.0:1788836451.835807:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (5633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.835823:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788836451.836350:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836451.836369:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.836384:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836451.836456:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.836491:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.836538:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.836687:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811264 00000100:00100000:0.0:1788836451.836695:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811264 00000100:00100000:0.0:1788836451.836719:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788836451.836725:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.836956:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.836963:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788836451.840955:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.841343:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.841425:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.841470:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.842416:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811392 00000100:00100000:3.0:1788836451.842426:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811392 00000100:00100000:3.0:1788836451.842478:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788836451.842486:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.842631:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.842746:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788836451.842868:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836451.843077:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171392 00000100:00100000:2.0:1788836451.843082:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171392 00000100:00100000:2.0:1788836451.843114:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:2.0:1788836451.843122:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770171392:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836451.843147:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836451.843165:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47800/0xf7b38383a6554019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1b7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.843191:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47800/0xf7b38383a6554019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b7 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.843202:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47800/0xf7b38383a6554019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b7 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.843211:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47800, rc 0) 00000100:00100000:2.0:1788836451.843249:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770171392:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.843255:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:2.0:1788836451.843297:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.843953:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10326:1875730782811520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.844809:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.844859:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.844929:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811520 00000100:00100000:2.0:1788836451.844937:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811520 00000100:00100000:2.0:1788836451.844993:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788836451.845037:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10326:x1875730782811520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.845162:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10326:x1875730782811520:12345-0@lo:502:llog_process_th.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.845170:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788836451.845255:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10326:1875730782811520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.845305:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10326:1875730782811648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.845353:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836451.845383:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf49639840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.845484:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811648 00000100:00100000:3.0:1788836451.845488:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811648 00000100:00100000:3.0:1788836451.845520:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788836451.845527:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10326:x1875730782811648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.845606:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:10326:x1875730782811648:12345-0@lo:502:llog_process_th.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.845613:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788836451.845693:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10326:1875730782811648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788836451.845714:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788836451.845874:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788836451.845908:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836451.845918:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.845929:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836451.845939:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788836451.845942:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788836451.845945:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788836451.845970:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.845978:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.845987:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.846041:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.846071:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.846091:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.846156:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811776 00000100:00100000:1.0:1788836451.846161:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811776 00000100:00100000:1.0:1788836451.846183:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788836451.846189:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782811776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836451.846198:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836451.846210:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993800/0xf7b38383a6554027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6554020 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.846233:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993800/0xf7b38383a6554027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6554020 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.846242:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993800/0xf7b38383a6554027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554020 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.846250:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993800, rc 0) 00000100:00100000:1.0:1788836451.846294:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782811776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.846299:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788836451.846417:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836451.846430:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.846439:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.846487:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.846687:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.846716:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.846778:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836451.848618:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782811904 00000100:00100000:2.0:1788836451.848633:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782811904 00000100:00100000:2.0:1788836451.848671:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171520 00000100:00100000:2.0:1788836451.848675:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171520 00000100:00100000:2.0:1788836451.848694:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788836451.848702:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782811904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.848866:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782811904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.848873:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788836451.848912:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:2.0:1788836451.848918:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770171520:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.848938:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782811904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.848989:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.848990:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770171520:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 71us (2214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836451.848996:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:3.0:1788836451.849161:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.849197:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.857418:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812032 00000100:00100000:2.0:1788836451.857435:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812032 00000100:00100000:2.0:1788836451.857491:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788836451.857501:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782812032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.857699:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782812032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (8538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.857707:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788836451.857912:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.859301:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10327:1875730782812160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.859376:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.859418:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.860457:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812160 00000100:00100000:2.0:1788836451.860468:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812160 00000100:00100000:2.0:1788836451.860513:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788836451.860523:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10327:x1875730782812160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.860669:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10327:x1875730782812160:12345-0@lo:502:llog_process_th.0 Request processed in 147us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.860677:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788836451.860708:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10327:1875730782812160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836451.860750:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836451.860764:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836451.860766:0:10327:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788836451.860772:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788836451.860801:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10327:1875730782812288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836451.860838:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.860876:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836451.862252:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812288 00000100:00100000:2.0:1788836451.862265:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812288 00000100:00100000:2.0:1788836451.862307:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788836451.862317:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10327:x1875730782812288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.862452:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10327:x1875730782812288:12345-0@lo:502:llog_process_th.0 Request processed in 135us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836451.862460:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788836451.862632:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10327:1875730782812288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836451.862663:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836451.862671:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836451.862673:0:10327:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788836451.862677:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788836451.864477:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788836451.864513:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788836451.864526:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.864538:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836451.864550:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788836451.864553:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf50b59800 from 48 10000000:01000000:2.0:1788836451.864556:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836451.864596:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.864605:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.864629:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836451.864655:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.864721:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.864770:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836451.864826:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812416 00000100:00100000:3.0:1788836451.864833:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812416 00000100:00100000:3.0:1788836451.864871:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788836451.864880:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782812416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836451.864902:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836451.864915:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701000/0xf7b38383a6554035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655402e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.864938:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701000/0xf7b38383a6554035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655402e expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.864949:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701000/0xf7b38383a6554035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655402e expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.864958:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701000, rc 0) 00000100:00100000:3.0:1788836451.865009:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782812416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836451.865117:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788836451.865734:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836451.865751:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.865761:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836451.865825:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.865858:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.865879:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.865945:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812544 00000100:00100000:1.0:1788836451.865950:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812544 00000100:00100000:1.0:1788836451.866000:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788836451.866037:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782812544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836451.866166:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782812544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.866173:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788836451.866363:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.866391:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.866433:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.866462:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.866502:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812672 00000100:00100000:0.0:1788836451.866506:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812672 00000100:00100000:0.0:1788836451.866541:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788836451.866548:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782812672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.866634:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782812672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.866651:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788836451.866740:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782812672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.867304:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10328:1875730782812800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.867344:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.867373:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.867476:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812800 00000100:00100000:1.0:1788836451.867487:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812800 00000100:00100000:1.0:1788836451.867525:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788836451.867532:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10328:x1875730782812800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836451.867641:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10328:x1875730782812800:12345-0@lo:502:llog_process_th.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.867648:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788836451.867720:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10328:1875730782812800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.867759:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10328:1875730782812928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.867790:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.867810:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.867850:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782812928 00000100:00100000:0.0:1788836451.867855:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782812928 00000100:00100000:0.0:1788836451.867903:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788836451.867911:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10328:x1875730782812928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.867998:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10328:x1875730782812928:12345-0@lo:502:llog_process_th.0 Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.868005:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788836451.868165:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10328:1875730782812928:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788836451.868186:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788836451.868389:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788836451.868410:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836451.868419:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.868428:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836451.868436:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788836451.868439:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788836451.868442:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836451.868464:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.868472:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.868480:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.868493:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.868524:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.868685:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.868929:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813056 00000100:00100000:1.0:1788836451.868935:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813056 00000100:00100000:1.0:1788836451.868979:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788836451.868987:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782813056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836451.868996:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836451.869038:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993a00/0xf7b38383a6554043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655403c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.869063:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993a00/0xf7b38383a6554043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655403c expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.869073:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993a00/0xf7b38383a6554043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655403c expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836451.869082:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993a00, rc 0) 00000100:00100000:1.0:1788836451.869123:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.869129:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788836451.869287:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836451.869302:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836451.869310:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836451.869362:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.869391:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.869425:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.869668:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813184 00000100:00100000:0.0:1788836451.869673:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813184 00000100:00100000:0.0:1788836451.869705:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788836451.869712:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.869837:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.869844:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788836451.869944:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.869986:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.870064:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.870081:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.870329:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813312 00000100:00100000:1.0:1788836451.870333:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813312 00000100:00100000:1.0:1788836451.870364:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788836451.870371:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836451.870466:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.870473:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788836451.870685:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836451.872199:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10329:1875730782813440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.872269:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.872321:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.872368:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813440 00000100:00100000:0.0:1788836451.872375:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813440 00000100:00100000:0.0:1788836451.872414:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788836451.872422:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10329:x1875730782813440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836451.872551:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10329:x1875730782813440:12345-0@lo:502:llog_process_th.0 Request processed in 130us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.872558:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788836451.873069:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10329:1875730782813440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836451.873099:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836451.873107:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836451.873110:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836451.873114:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836451.873135:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10329:1875730782813568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836451.873168:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836451.873186:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade427756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.873260:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813568 00000100:00100000:1.0:1788836451.873265:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813568 00000100:00100000:1.0:1788836451.873298:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788836451.873305:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10329:x1875730782813568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836451.873389:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10329:x1875730782813568:12345-0@lo:502:llog_process_th.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836451.873396:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788836451.874678:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10329:1875730782813568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836451.874717:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836451.874727:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836451.874730:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788836451.874734:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788836451.874842:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788836451.874865:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836451.874876:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.874899:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836451.874926:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788836451.874929:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adf48a1cd28 from 1 10000000:01000000:3.0:1788836451.874933:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836451.874968:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.874977:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.874987:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.875007:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.875167:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.875204:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836451.875246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813696 00000100:00100000:0.0:1788836451.875253:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813696 00000100:00100000:0.0:1788836451.875298:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788836451.875307:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782813696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836451.875326:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836451.875341:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f7600/0xf7b38383a6554051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655404a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.875364:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f7600/0xf7b38383a6554051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655404a expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.875375:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f7600/0xf7b38383a6554051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655404a expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836451.875384:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7600, rc 0) 00000100:00100000:0.0:1788836451.875429:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782813696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836451.875436:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788836451.875526:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836451.875665:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.875677:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836451.875728:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836451.876180:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836451.876249:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836451.880837:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813824 00000100:00100000:1.0:1788836451.880855:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813824 00000100:00100000:0.0:1788836451.884252:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788836451.884265:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782813824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836451.884409:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782813824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (8229us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836451.884417:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788836451.884856:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782813824:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788836451.884910:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788836451.884939:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836451.884951:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.094283:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836452.094307:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782813952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836452.094380:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836452.094509:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782813952 00000100:00100000:3.0:1788836452.094518:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782813952 00000100:00100000:3.0:1788836452.094570:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788836452.094581:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782813952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836452.094616:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836452.094665:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782813952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836452.094671:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836452.094849:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782813952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836452.290324:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836452.290363:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836452.290391:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836452.290596:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836452.290629:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171648 00000100:00100000:3.0:1788836452.290639:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171648 00000100:00100000:3.0:1788836452.290766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171776 00000100:00100000:3.0:1788836452.290770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171776 00000100:00100000:3.0:1788836452.290792:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836452.290803:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770171648:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836452.290934:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836452.290945:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770171648:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836452.290946:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788836452.290957:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836452.290976:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788836452.290992:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770171776:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836452.291121:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770171776:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 130us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836452.291128:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788836452.291151:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172032 00000100:00100000:3.0:1788836452.291154:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172032 00000100:00100000:3.0:1788836452.291181:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770171904 00000100:00100000:3.0:1788836452.291184:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770171904 00000100:00100000:3.0:1788836452.291210:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836452.291217:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770172032:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836452.291244:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770172032:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836452.291253:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836452.291269:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1788836452.291276:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770171904:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:0.0:1788836452.291286:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836452.291292:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836452.291295:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836452.291298:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836452.291304:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770171904:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836452.291312:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00010000:00010000:3.0:1788836452.738452:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836452.819001:0:10367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd2832a10 20000000:00000080:1.0:1788836452.819415:0:10367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ade42b38c00 uarg=0000000000000000 20000000:01000000:1.0:1788836452.819459:0:10367:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836452.819465:0:10367:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836452.819470:0:10367:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788836452.819895:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788836452.820269:0:10367:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788836452.824864:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788836452.824911:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788836452.824927:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788836452.824942:0:10367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788836452.824963:0:10367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.824992:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553ced expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825000:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825007:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825058:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825067:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825074:0:10367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825114:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825129:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 9 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.825143:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814080:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836452.825729:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.825739:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 23 pid: 6484 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.825819:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814208:0@lo:104: 00000100:00100000:1.0:1788836452.825861:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836452.826269:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.826280:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 23 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.826289:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814336:0@lo:104: 00000100:00100000:1.0:1788836452.826324:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.831391:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836452.831582:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172160 00000100:00100000:3.0:1788836452.831593:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172160 00010000:00010000:3.0:1788836452.831635:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 10 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836452.831677:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1788836452.831687:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770172160:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836452.831716:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836452.831722:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 10 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836452.831735:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 10 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836452.831756:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836452.831810:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770172160:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 124us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836452.831817:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00010000:00010000:1.0:1788836452.833253:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.833269:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 23 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.833283:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814464:0@lo:104: 00010000:00010000:1.0:1788836452.833515:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836452.833524:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 23 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.833532:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814592:0@lo:104: 00000100:00100000:1.0:1788836452.833549:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788836452.833574:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82173000/0xf7b38383a6553f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa178 expref: 9 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836452.833607:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814080:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836452.833717:0:7432:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788836452.833742:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836452.833807:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.833956:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1788836452.833962:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814208 00000100:00100000:2.0:1788836452.833967:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814208 00000100:00100000:2.0:1788836452.834004:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814336 00000100:00100000:2.0:1788836452.834007:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814336 00000100:00100000:2.0:1788836452.834060:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814464 00000100:00100000:2.0:1788836452.834064:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814464 00000100:00100000:2.0:1788836452.834073:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814592 00000100:00100000:2.0:1788836452.834076:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814592 00000100:00100000:2.0:1788836452.834088:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836452.834096:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:10367:x1875730782814208:12345-0@lo:104: 00010000:00010000:2.0:1788836452.834109:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834412:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836452.834436:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:10367:x1875730782814208:12345-0@lo:104: Request processed in 340us (8574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.834442:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836452.834461:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836452.834467:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43959850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10367:x1875730782814336:12345-0@lo:104: 00010000:00010000:2.0:1788836452.834474:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834508:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836452.834513:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43959850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:10367:x1875730782814336:12345-0@lo:104: Request processed in 48us (8189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.834518:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836452.834545:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836452.834550:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10367:x1875730782814464:12345-0@lo:104: 00010000:00010000:2.0:1788836452.834557:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834588:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788836452.834593:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:10367:x1875730782814464:12345-0@lo:104: Request processed in 43us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.834598:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836452.834609:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836452.834615:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10367:x1875730782814592:12345-0@lo:104: 00010000:00010000:2.0:1788836452.834622:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834647:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788836452.834657:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:10367:x1875730782814592:12345-0@lo:104: Request processed in 43us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.834664:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788836452.834682:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788836452.834688:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834695:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836452.834698:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834707:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836452.834714:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836452.834720:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836452.834747:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834753:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836452.834786:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834793:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40030800/0xf7b38383a6553e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553e7c expref: -99 pid: 9482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834805:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836452.834808:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834824:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836452.834827:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834833:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836452.834838:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836452.834843:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836452.834857:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834862:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836452.834887:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834894:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f46400/0xf7b38383a6553d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d56 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834904:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836452.834907:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834912:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836452.834915:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834932:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836452.834938:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836452.834943:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836452.834956:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834961:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836452.834967:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834972:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700c00/0xf7b38383a6553cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553d02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834980:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836452.834983:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834987:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836452.834989:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.834995:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836452.835000:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836452.835033:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836452.835047:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835053:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836452.835059:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835065:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a6553ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6553cf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835077:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836452.835079:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836452.835081:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836452.835087:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836452.835092:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836452.835104:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782814720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835154:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.835186:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836452.835193:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782815104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835213:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.835241:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782814848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835263:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.835279:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836452.835284:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782814976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835315:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836452.835337:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814720 00000100:00100000:2.0:1788836452.835347:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814720 00010000:00010000:2.0:1788836452.835367:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 24 pid: 6484 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836452.835381:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815104 00000100:00100000:2.0:1788836452.835384:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815104 00010000:00010000:2.0:1788836452.835393:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 25 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836452.835403:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814848 00000100:00100000:2.0:1788836452.835405:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814848 00010000:00010000:2.0:1788836452.835414:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 26 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836452.835423:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782814976 00000100:00100000:2.0:1788836452.835425:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782814976 00010000:00010000:2.0:1788836452.835435:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 27 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836452.835446:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836452.835452:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3617:x1875730782814720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836452.835462:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836452.835466:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 27 pid: 6484 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835477:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 27 pid: 6484 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835493:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836452.835522:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3617:x1875730782814720:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.835529:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836452.835548:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836452.835554:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3617:x1875730782815104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836452.835561:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836452.835566:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 26 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835574:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 26 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835584:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836452.835606:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3617:x1875730782815104:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.835611:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836452.835623:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836452.835628:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782814848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836452.835635:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836452.835639:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 25 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835645:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 25 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835654:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836452.835679:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782814848:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.835684:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836452.835713:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836452.835719:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782814976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836452.835734:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836452.835739:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 24 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835748:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 24 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835760:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835768:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835781:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835788:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835794:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835800:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835805:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836452.835809:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835815:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835833:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836452.835842:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836452.835874:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782814976:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836452.835881:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836452.835917:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782814976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835925:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782814848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835949:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782815104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836452.835956:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782814720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836452.836495:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eba00/0xf7b38383a6553e7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553e75 expref: 23 pid: 6484 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836452.836510:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814208:0@lo:104: 00010000:00010000:3.0:1788836452.836522:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6553d56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553d4f expref: 22 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836452.836530:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814336:0@lo:104: 00010000:00010000:3.0:1788836452.836539:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eb400/0xf7b38383a6553d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553cfb expref: 21 pid: 6485 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836452.836547:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814464:0@lo:104: 00010000:00010000:3.0:1788836452.836555:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6553cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6553ced expref: 20 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836452.836562:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875730782814592:0@lo:104: 00010000:00010000:3.0:1788836452.836585:0:10367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836452.836603:0:10367:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836452.836609:0:10367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836452.836614:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992000/0xf7b38383a6554058 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836453.118296:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836453.118316:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782815232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836453.118370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.118475:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815232 00000100:00100000:3.0:1788836453.118483:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815232 00000100:00100000:3.0:1788836453.118541:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836453.118547:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782815232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836453.118573:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836453.118611:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782815232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836453.118615:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788836453.118645:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5180 x1875730782815232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836453.118658:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782815232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788836453.118703:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836453.119140:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836453.119148:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782815360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836453.119171:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836453.119222:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815360 00000100:00100000:1.0:1788836453.119226:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815360 00000100:00100000:1.0:1788836453.119255:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836453.119259:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782815360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836453.119268:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836453.119290:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782815360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836453.119294:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788836453.119369:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836453.119385:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43923480 x1875730782815360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836453.119410:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782815360:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1788836453.144469:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836453.144476:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7fbb1000 from 4 10000000:01000000:3.0:1788836453.144482:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836453.144530:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.144541:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.144552:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836453.144578:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.144647:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.144728:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf50752c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836453.144885:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815488 00000100:00100000:0.0:1788836453.144906:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815488 00000100:00100000:0.0:1788836453.144963:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788836453.144972:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782815488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836453.144986:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836453.145000:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655405f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.145058:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655405f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.145068:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655405f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.145076:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00100000:0.0:1788836453.145127:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782815488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.145134:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788836453.145663:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836453.145680:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.145689:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836453.145827:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.145857:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.145898:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf50752c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.145963:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815616 00000100:00100000:2.0:1788836453.145969:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815616 00000100:00100000:2.0:1788836453.146008:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788836453.146047:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782815616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.146573:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782815616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 525us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.146581:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788836453.147325:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.147389:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.147453:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.147480:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf50752c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836453.147647:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815744 00000100:00100000:1.0:1788836453.147654:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815744 00000100:00100000:1.0:1788836453.147701:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788836453.147710:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782815744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836453.147833:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782815744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836453.147840:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788836453.147992:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782815744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.148573:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10380:1875730782815872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836453.148617:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.148650:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf50752540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.148713:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782815872 00000100:00100000:2.0:1788836453.148719:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782815872 00000100:00100000:2.0:1788836453.148759:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788836453.148768:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10380:x1875730782815872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.148876:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10380:x1875730782815872:12345-0@lo:502:llog_process_th.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.148893:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788836453.148975:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10380:1875730782815872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836453.148999:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836453.149007:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836453.149039:0:10380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788836453.149048:0:10380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf7fbb1000 00000020:00000080:3.0:1788836453.149051:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788836453.149122:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10380:1875730782816000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836453.149155:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.149184:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf50752540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836453.149449:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816000 00000100:00100000:0.0:1788836453.149454:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816000 00000100:00100000:0.0:1788836453.149491:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788836453.149498:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10380:x1875730782816000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.149578:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:10380:x1875730782816000:12345-0@lo:502:llog_process_th.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.149585:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788836453.149669:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10380:1875730782816000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836453.149688:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836453.149693:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836453.149694:0:10380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788836453.149698:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788836453.149898:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788836453.149919:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836453.149929:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.149951:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836453.149962:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836453.149964:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7a54e000 from 4 10000000:01000000:0.0:1788836453.149966:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836453.149992:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.150000:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.150008:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836453.150064:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.150095:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.150115:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.150167:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816128 00000100:00100000:2.0:1788836453.150171:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816128 00000100:00100000:2.0:1788836453.150198:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788836453.150204:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782816128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836453.150214:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836453.150227:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655406d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.150248:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655406d expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.150257:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655406d expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.150266:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46400, rc 0) 00000100:00100000:2.0:1788836453.150306:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.150311:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788836453.151087:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836453.151103:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.151113:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836453.151164:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.151193:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.151232:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836453.151273:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816256 00000100:00100000:3.0:1788836453.151277:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816256 00000100:00100000:3.0:1788836453.151303:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788836453.151308:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.151398:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836453.151402:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788836453.151464:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.151489:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.151524:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.151544:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836453.154686:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816384 00000100:00100000:3.0:1788836453.154698:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816384 00000100:00100000:3.0:1788836453.154747:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788836453.154754:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.154915:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836453.154921:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788836453.155407:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.155797:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10381:1875730782816512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836453.155848:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836453.155902:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4338bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836453.166414:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816512 00000100:00100000:0.0:1788836453.166447:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816512 00000100:00100000:0.0:1788836453.166514:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788836453.166525:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10381:x1875730782816512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.166704:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10381:x1875730782816512:12345-0@lo:502:llog_process_th.0 Request processed in 179us (10855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.166712:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788836453.166778:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10381:1875730782816512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836453.166811:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836453.166820:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836453.166822:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836453.166833:0:10381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf7a54e000 00000020:00000080:0.0:1788836453.166835:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836453.166934:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10381:1875730782816640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.166974:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.166999:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.167850:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816640 00000100:00100000:2.0:1788836453.167858:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816640 00000100:00100000:2.0:1788836453.167981:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788836453.167989:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10381:x1875730782816640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.168113:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:10381:x1875730782816640:12345-0@lo:502:llog_process_th.0 Request processed in 123us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.168120:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788836453.168219:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10381:1875730782816640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836453.168245:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836453.168252:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836453.168261:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788836453.168269:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788836453.168383:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788836453.168404:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836453.168415:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836453.168703:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836453.168723:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836453.168726:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf444f2000 from 4 10000000:01000000:1.0:1788836453.168728:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836453.168755:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836453.168764:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836453.168773:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836453.168791:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836453.168827:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836453.168873:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.168918:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816768 00000100:00100000:2.0:1788836453.168929:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816768 00000100:00100000:2.0:1788836453.168956:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788836453.168963:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782816768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836453.168974:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836453.168986:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655407b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.169008:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655407b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.169038:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655407b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.169045:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47a00, rc 0) 00000100:00100000:2.0:1788836453.169081:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782816768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.169087:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788836453.169140:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836453.169153:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836453.169161:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836453.169211:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836453.169238:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836453.169263:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.171765:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782816896 00000100:00100000:2.0:1788836453.171782:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782816896 00000100:00100000:2.0:1788836453.171833:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788836453.171843:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782816896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.172154:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782816896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.172162:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788836453.172217:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782816896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.172266:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.172311:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836453.172344:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775780 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.172357:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817024 00000100:00100000:2.0:1788836453.172361:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817024 00000100:00100000:2.0:1788836453.172383:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788836453.172389:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782817024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.172462:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782817024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.172468:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788836453.172507:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.172711:0:10384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10384:1875730782817152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.172742:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836453.172761:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817152 00000100:00100000:2.0:1788836453.172764:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817152 00000100:00100000:2.0:1788836453.172783:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788836453.172788:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10384:x1875730782817152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.172854:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10384:x1875730782817152:12345-0@lo:502:llog_process_th.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.172873:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788836453.173130:0:10384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.173143:0:10384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10384:1875730782817152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836453.173164:0:10384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836453.173173:0:10384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836453.173175:0:10384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788836453.173181:0:10384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf444f2000 00000020:00000080:2.0:1788836453.173183:0:10384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836453.173423:0:10384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10384:1875730782817280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.173468:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836453.173489:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817280 00000100:00100000:2.0:1788836453.173494:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817280 00000100:00100000:2.0:1788836453.173518:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788836453.173525:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10384:x1875730782817280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836453.173596:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:10384:x1875730782817280:12345-0@lo:502:llog_process_th.0 Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.173602:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788836453.173631:0:10384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.173643:0:10384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10384:1875730782817280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836453.173661:0:10384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836453.173665:0:10384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836453.173667:0:10384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788836453.173669:0:10384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788836453.173726:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788836453.173746:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836453.173756:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.173765:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836453.173775:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836453.173778:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf50b59800 from 4 10000000:01000000:2.0:1788836453.173781:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836453.173803:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.173810:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836453.173826:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836453.173838:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.174187:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836453.174251:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836453.174285:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817408 00000100:00100000:3.0:1788836453.174290:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817408 00000100:00100000:3.0:1788836453.174352:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788836453.174359:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782817408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836453.174368:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836453.174380:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6554089 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.174404:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6554089 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.174414:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554089 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836453.174432:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700a00, rc 0) 00000100:00100000:3.0:1788836453.174515:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782817408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836453.174522:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788836453.174588:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836453.174602:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.174611:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836453.174669:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.174696:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.174751:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836453.174783:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817536 00000100:00100000:3.0:1788836453.174787:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817536 00000100:00100000:3.0:1788836453.174817:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788836453.174823:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782817536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836453.175094:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782817536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836453.175102:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788836453.175189:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.175218:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.175258:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.175317:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836453.175347:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817664 00000100:00100000:2.0:1788836453.175351:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817664 00000100:00100000:2.0:1788836453.175409:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788836453.175416:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782817664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.175497:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782817664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.175504:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788836453.175560:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782817664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836453.175722:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10385:1875730782817792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.175756:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.175815:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836453.175844:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817792 00000100:00100000:3.0:1788836453.175848:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817792 00000100:00100000:3.0:1788836453.176146:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788836453.176156:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:10385:x1875730782817792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836453.176243:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:10385:x1875730782817792:12345-0@lo:502:llog_process_th.0 Request processed in 89us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.176287:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10385:1875730782817792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836453.176309:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836453.176319:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836453.176321:0:10385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836453.176330:0:10385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf50b59800 00000020:00000080:0.0:1788836453.176333:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836453.176413:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10385:1875730782817920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.176446:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836453.176465:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782817920 00000100:00100000:0.0:1788836453.176469:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782817920 00000100:00100000:0.0:1788836453.176489:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788836453.176495:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:10385:x1875730782817920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836453.176572:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:10385:x1875730782817920:12345-0@lo:502:llog_process_th.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.176579:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788836453.176619:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836453.176631:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:10385:1875730782817920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836453.176648:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836453.176652:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836453.176653:0:10385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788836453.176657:0:10385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788836453.176717:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788836453.176735:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836453.176744:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.176754:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836453.177326:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788836453.441789:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836453.441923:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172288 00000100:00100000:0.0:1788836453.441934:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172288 00000100:00100000:0.0:1788836453.441992:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 270 00000100:00100000:0.0:1788836453.442001:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:6171:x1875730770172288:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836453.442054:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836453.442087:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1be expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.442116:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.442128:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836453.442137:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6800, rc 0) 00000100:00100000:0.0:1788836453.442200:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770172288:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 200us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.442206:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 270 00000100:00100000:3.0:1788836453.445598:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836453.446003:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172416 00000100:00100000:2.0:1788836453.446046:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172416 00000100:00100000:2.0:1788836453.446102:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 271 00000100:00100000:2.0:1788836453.446112:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770172416:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.446250:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770172416:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 139us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.446257:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 271 00000100:00100000:3.0:1788836453.448638:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836453.448914:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172544 00000100:00100000:2.0:1788836453.448924:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172544 00000100:00100000:2.0:1788836453.448975:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 272 00000100:00100000:2.0:1788836453.448984:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770172544:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836453.449149:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6171:x1875730770172544:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 165us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.449164:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 272 00000100:00100000:3.0:1788836453.452642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836453.452837:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172672 00000100:00100000:0.0:1788836453.452850:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172672 00000100:00100000:0.0:1788836453.452913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 273 00000100:00100000:0.0:1788836453.452923:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6710:x1875730770172672:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836453.453118:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6710:x1875730770172672:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 196us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836453.453126:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 273 00000100:00100000:3.0:1788836453.455196:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836453.455377:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172800 00000100:00100000:2.0:1788836453.455388:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172800 00000100:00100000:2.0:1788836453.455449:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 274 00000100:00100000:2.0:1788836453.455458:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6710:x1875730770172800:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836453.455590:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:6710:x1875730770172800:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 133us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836453.455597:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 274 00010000:00010000:2.0:1788836453.759234:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836454.144327:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836454.144348:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782818048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836454.144420:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836454.144499:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818048 00000100:00100000:0.0:1788836454.144507:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818048 00000100:00100000:0.0:1788836454.144554:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836454.144563:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782818048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836454.144596:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788836454.144654:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782818048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836454.144661:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836454.144708:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782818048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836454.656515:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782818304:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656586:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656653:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782818816:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656695:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782819328:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656715:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656736:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836454.656742:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782818176:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656769:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656790:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782818688:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656811:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656830:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782819200:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656866:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656889:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782818432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656911:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656929:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782818944:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656952:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.656968:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782819456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.656987:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.657004:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836454.657036:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782818560:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.657080:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819072:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657100:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.657116:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819584:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657132:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.657164:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818304 00000100:00100000:1.0:1788836454.657171:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818304 00000100:00100000:1.0:1788836454.657205:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818816 00000100:00100000:1.0:1788836454.657208:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818816 00000100:00100000:1.0:1788836454.657228:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819328 00000100:00100000:1.0:1788836454.657232:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819328 00000100:00100000:1.0:1788836454.657243:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818688 00000100:00100000:1.0:1788836454.657245:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818688 00000100:00100000:1.0:1788836454.657254:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819200 00000100:00100000:1.0:1788836454.657256:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819200 00000100:00100000:1.0:1788836454.657284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818432 00000100:00100000:1.0:1788836454.657287:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818432 00000100:00100000:1.0:1788836454.657302:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836454.657310:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782818304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657365:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782818304:12345-0@lo:400:kworker.0 Request processed in 55us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657372:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836454.657389:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836454.657395:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782818816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657422:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782818816:12345-0@lo:400:kworker.0 Request processed in 28us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836454.657438:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836454.657444:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782819328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657471:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782819328:12345-0@lo:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657476:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836454.657487:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836454.657493:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782818688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657527:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782818688:12345-0@lo:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657534:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836454.657546:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836454.657552:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782819200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657577:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782819200:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657583:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836454.657593:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836454.657599:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782818432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657628:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782818432:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657634:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836454.657656:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818944 00000100:00100000:1.0:1788836454.657660:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818944 00000100:00100000:1.0:1788836454.657678:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819456 00000100:00100000:1.0:1788836454.657681:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819456 00000100:00100000:1.0:1788836454.657691:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819072 00000100:00100000:1.0:1788836454.657694:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819072 00000100:00100000:1.0:1788836454.657703:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819584 00000100:00100000:1.0:1788836454.657706:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819584 00000100:00100000:1.0:1788836454.657718:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836454.657725:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782818944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657756:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782818944:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657762:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836454.657773:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836454.657785:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782819456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657815:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782819456:12345-0@lo:400:kworker.0 Request processed in 31us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657821:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836454.657832:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836454.657849:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657876:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819072:12345-0@lo:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657882:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836454.657893:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836454.657899:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.657926:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819584:12345-0@lo:400:kworker.0 Request processed in 28us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.657931:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836454.657949:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818560 00000100:00100000:1.0:1788836454.657952:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818560 00000100:00100000:1.0:1788836454.657978:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836454.657985:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782818560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.658042:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782818560:12345-0@lo:400:kworker.0 Request processed in 58us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.658048:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836454.658089:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782818688:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.658102:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782819200:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.658112:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782818304:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658137:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920a80 x1875730782818816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658148:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782818816:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658159:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43922a00 x1875730782819328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658168:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782819328:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.658210:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782818560:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658221:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43921f80 x1875730782819072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658230:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819072:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658240:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43921880 x1875730782819584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658247:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819584:0@lo:400:kworker.0 00000100:00100000:1.0:1788836454.658257:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782818432:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658265:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43922300 x1875730782818944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658273:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782818944:0@lo:400:kworker.0 00010000:00080000:1.0:1788836454.658281:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920380 x1875730782819456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836454.658287:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782819456:0@lo:400:kworker.0 00000100:00100000:3.0:1788836454.658421:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782818176 00000100:00100000:3.0:1788836454.658426:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782818176 00000100:00100000:3.0:1788836454.658459:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788836454.658465:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782818176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836454.658507:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782818176:12345-0@lo:400:kworker.0 Request processed in 42us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836454.658513:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:3.0:1788836454.658548:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836454.658553:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836454.658555:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836454.658568:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782818176:0@lo:400:kworker.0 00000100:00100000:3.0:1788836454.663060:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836454.663086:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782819712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836454.663155:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836454.663215:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819712 00000100:00100000:1.0:1788836454.663229:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819712 00000100:00100000:1.0:1788836454.663294:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836454.663304:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782819712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836454.663336:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836454.663394:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782819712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836454.663403:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788836454.663553:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155e300 x1875730782819712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836454.663572:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782819712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836454.786749:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836455.169881:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836455.169906:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782819840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836455.169972:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836455.170212:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819840 00000100:00100000:3.0:1788836455.170220:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819840 00000100:00100000:3.0:1788836455.170273:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836455.170281:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782819840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836455.170304:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836455.170354:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782819840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836455.170361:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788836455.170439:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebd880 x1875730782819840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836455.170458:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782819840:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836455.807093:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836456.832715:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836457.214234:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836457.214308:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836457.227732:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782819968 00000100:00100000:3.0:1788836457.227748:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782819968 00000100:00100000:3.0:1788836457.227830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788836457.227841:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836457.227883:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836457.227983:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782819968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (13675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836457.227990:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836457.229463:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782819968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836457.417134:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836457.417177:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836457.417208:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836457.417228:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836457.417250:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836457.417278:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173184 00000100:00100000:2.0:1788836457.417288:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173184 00000100:00100000:2.0:1788836457.417359:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173056 00000100:00100000:2.0:1788836457.417363:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173056 00000100:00100000:2.0:1788836457.417388:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788836457.417398:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173184:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836457.417475:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173184:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836457.417490:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788836457.417509:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1788836457.417515:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770173056:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836457.417543:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770173056:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836457.417550:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1788836457.417570:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173440 00000100:00100000:2.0:1788836457.417573:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173440 00000100:00100000:2.0:1788836457.417597:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173312 00000100:00100000:2.0:1788836457.417600:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173312 00000100:00100000:2.0:1788836457.417620:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788836457.417626:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836457.417651:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836457.417657:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788836457.417667:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:2.0:1788836457.417672:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836457.417690:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770173312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 18us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836457.417695:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00080000:2.0:1788836457.417714:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836457.417718:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836457.417720:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836457.417721:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836457.417920:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770172928 00000100:00100000:0.0:1788836457.417925:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770172928 00000100:00100000:0.0:1788836457.417962:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 276 00000100:00100000:0.0:1788836457.417970:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770172928:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836457.418008:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770172928:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836457.418036:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 276 00010000:00010000:1.0:1788836457.855119:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836458.244305:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782820096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836458.244379:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836458.244463:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836458.244472:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836458.244482:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820096 00000100:00100000:3.0:1788836458.244498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836458.244502:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820096 00000100:00100000:3.0:1788836458.244540:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820224 00000100:00100000:3.0:1788836458.244544:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820224 00000100:00100000:2.0:1788836458.244553:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836458.244562:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782820096:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836458.244563:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836458.244568:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782820224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836458.244589:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788836458.244592:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836458.244637:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782820224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836458.244645:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836458.246555:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782820096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1986us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836458.246569:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788836458.246811:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6680 x1875730782820224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836458.246837:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782820224:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788836458.247256:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6300 x1875730782820096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836458.247306:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782820096:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836458.247460:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788836458.878158:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836459.263292:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836459.263325:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782820352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836459.263675:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836459.263781:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820352 00000100:00100000:0.0:1788836459.263791:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820352 00000100:00100000:0.0:1788836459.263854:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788836459.263865:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782820352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836459.265242:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836459.266130:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782820352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836459.267534:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782820352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1531us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836459.267568:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000001:02000400:2.0:1788836459.397934:0:10667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788836459.778296:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836459.778331:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836459.778428:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836459.778685:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820480 00000100:00100000:1.0:1788836459.778696:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820480 00000100:00100000:1.0:1788836459.778790:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836459.778803:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782820480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836459.778844:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788836459.778956:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836459.779138:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782820480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836459.779146:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836459.781421:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782820992:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.781466:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782820864:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.781507:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.781518:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836459.781564:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782821376:0@lo:400:kworker.0 00000100:00100000:1.0:1788836459.781633:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820864 00000100:00100000:1.0:1788836459.781643:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820864 00000100:00100000:1.0:1788836459.781711:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836459.781722:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782820864:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788836459.783377:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155c700 x1875730782820480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836459.783412:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836459.783455:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782820608:0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.786766:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782821504:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.786831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.786850:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820992 00000100:00100000:2.0:1788836459.786861:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820992 00000100:00100000:0.0:1788836459.786883:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782821888:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.786907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.786931:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836459.786935:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788836459.786940:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782820992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.786942:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782820736:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.786969:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836459.786986:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782821248:0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.787005:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782820992:12345-0@lo:400:kworker.0 Request processed in 66us (5498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836459.787008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.787029:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836459.787049:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782821760:0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.787057:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820736 00000100:00100000:2.0:1788836459.787060:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820736 00000100:00100000:0.0:1788836459.787070:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.787077:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821248 00000100:00100000:2.0:1788836459.787080:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821248 00000100:00100000:0.0:1788836459.787107:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821760 00000100:00100000:0.0:1788836459.787111:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821760 00000100:00100000:2.0:1788836459.787120:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788836459.787126:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782820736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.787138:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788836459.787148:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788836459.787164:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782820736:12345-0@lo:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.787170:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788836459.787204:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836459.787210:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782821248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.787241:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782821248:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.787247:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836459.787258:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836459.787263:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782821760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.787290:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782821760:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.787296:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788836459.791265:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836459.791322:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.791472:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782820992:0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.791546:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821376 00000100:00100000:2.0:1788836459.791556:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821376 00000100:00100000:2.0:1788836459.791620:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821888 00000100:00100000:2.0:1788836459.791623:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821888 00000100:00100000:2.0:1788836459.791647:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821504 00000100:00100000:2.0:1788836459.791650:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821504 00000100:00100000:2.0:1788836459.791666:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836459.791675:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782821376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.791789:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782821376:12345-0@lo:400:kworker.0 Request processed in 113us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.791797:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836459.791816:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836459.791822:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.791854:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782821888:12345-0@lo:400:kworker.0 Request processed in 32us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.792000:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836459.792031:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836459.792038:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.792075:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782821504:12345-0@lo:400:kworker.0 Request processed in 38us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.792082:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788836459.792103:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788836459.792128:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc22680 x1875730782821504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836459.792140:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782821504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836459.792302:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782820864:12345-0@lo:400:kworker.0 Request processed in 10580us (10793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836459.792322:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836459.792380:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782820736:0@lo:400:kworker.0 00010000:00080000:1.0:1788836459.792398:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc22d80 x1875730782821248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836459.792423:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782821248:0@lo:400:kworker.0 00010000:00080000:1.0:1788836459.792440:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc21f80 x1875730782821760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836459.792449:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782821760:0@lo:400:kworker.0 00000100:00100000:1.0:1788836459.792462:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782820864:0@lo:400:kworker.0 00010000:00080000:1.0:1788836459.792474:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20700 x1875730782821376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836459.792482:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782821376:0@lo:400:kworker.0 00010000:00080000:1.0:1788836459.792493:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc23100 x1875730782821888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836459.792502:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782821888:0@lo:400:kworker.0 00000100:00100000:3.0:1788836459.794772:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836459.796130:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782821120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836459.796222:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836459.796270:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782821632:0@lo:400:kworker.0 00000100:00100000:3.0:1788836459.796293:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836459.796361:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782820608 00000100:00100000:2.0:1788836459.796372:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782820608 00000100:00100000:2.0:1788836459.796438:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788836459.796449:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782820608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836459.796685:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782820608:12345-0@lo:400:kworker.0 Request processed in 235us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836459.796695:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788836459.799161:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782820608:0@lo:400:kworker.0 00000100:00100000:0.0:1788836459.800734:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821120 00000100:00100000:0.0:1788836459.800765:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821120 00000100:00080000:3.0:1788836459.801817:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836459.802045:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782821632 00000100:00100000:1.0:1788836459.802056:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782821632 00000100:00100000:1.0:1788836459.803074:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836459.803092:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782821120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836459.803232:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782821120:12345-0@lo:400:kworker.0 Request processed in 145us (7009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836459.803240:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836459.803264:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788836459.803271:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782821632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836459.803304:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782821632:12345-0@lo:400:kworker.0 Request processed in 34us (7009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836459.803332:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788836459.803469:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836459.803521:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782821120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836459.803536:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782821632:0@lo:400:kworker.0 00010000:00010000:3.0:1788836459.903987:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836460.288491:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782822016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836460.288570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836460.288667:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822016 00000100:00100000:0.0:1788836460.288674:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822016 00000100:00100000:0.0:1788836460.288722:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788836460.288732:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782822016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836460.288790:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836460.288840:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782822016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836460.288848:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788836460.288896:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc23480 x1875730782822016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836460.288916:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782822016:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836460.927241:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836461.950472:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836462.334772:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782822144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836462.336652:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836462.337609:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822144 00000100:00100000:1.0:1788836462.337620:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822144 00000100:00100000:1.0:1788836462.337674:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836462.337684:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782822144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836462.337733:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836462.337790:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782822144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836462.338431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836462.338496:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782822144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836462.539730:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836462.539833:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836462.539865:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836462.539888:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836462.539913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836462.539941:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174080 00000100:00100000:2.0:1788836462.539951:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174080 00000100:00100000:2.0:1788836462.540005:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173952 00000100:00100000:2.0:1788836462.540043:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173952 00000100:00100000:2.0:1788836462.540073:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1788836462.540083:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770174080:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836462.540167:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770174080:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836462.540175:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1788836462.540189:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788836462.540195:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770173952:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836462.540216:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770173952:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836462.540221:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00080000:2.0:1788836462.540241:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836462.540245:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836462.543251:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173824 00000100:00100000:1.0:1788836462.543266:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173824 00000100:00100000:1.0:1788836462.543342:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173696 00000100:00100000:1.0:1788836462.543347:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173696 00000100:00100000:1.0:1788836462.543387:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:1.0:1788836462.543398:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770173824:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836462.543471:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770173824:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 76us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836462.543479:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:1.0:1788836462.543496:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:1.0:1788836462.543503:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770173696:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836462.543526:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770173696:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836462.543532:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00080000:2.0:1788836462.543786:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836462.543792:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836462.546266:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770173568 00000100:00100000:0.0:1788836462.546279:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770173568 00000100:00100000:0.0:1788836462.546438:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 278 00000100:00100000:0.0:1788836462.546449:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2396:x1875730770173568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836462.546531:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2396:x1875730770173568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836462.546538:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 278 00010000:00010000:1.0:1788836462.974741:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836463.359271:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782822272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836463.359365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836463.359465:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822272 00000100:00100000:3.0:1788836463.359476:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822272 00000100:00100000:3.0:1788836463.359616:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836463.359627:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782822272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836463.359661:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836463.359732:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782822272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836463.359740:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788836463.360457:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6d80 x1875730782822272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836463.360476:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782822272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836463.360494:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836463.360500:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782822400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836463.360549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836463.360586:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822400 00000100:00100000:0.0:1788836463.360591:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822400 00000100:00080000:1.0:1788836463.361568:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836463.373959:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836463.373974:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782822400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836463.374033:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836463.374124:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782822400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (13574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836463.374132:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788836463.374228:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc23480 x1875730782822400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836463.374250:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782822400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788836464.000828:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836464.382209:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836464.382233:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782822528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836464.382307:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836464.382381:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822528 00000100:00100000:3.0:1788836464.382389:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822528 00000100:00100000:3.0:1788836464.382437:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836464.382446:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782822528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836464.382479:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836464.382645:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782822528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836464.382653:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836464.382712:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782822528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836464.894280:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782822656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836464.894350:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.894468:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822656 00000100:00100000:1.0:1788836464.894476:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822656 00000100:00100000:1.0:1788836464.894539:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836464.894549:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782822656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836464.894579:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836464.894624:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782822656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.894631:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788836464.894925:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788836464.894955:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155c380 x1875730782822656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836464.894982:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782822656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836464.905454:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782822912:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905524:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905567:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782823424:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905588:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905604:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905644:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836464.905649:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782822784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905688:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905709:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782823296:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905738:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905755:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782823808:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905797:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782823168:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905823:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905841:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782823680:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905864:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905884:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788836464.905889:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782823040:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905911:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905921:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782823552:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905940:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.905957:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782824064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.905992:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836464.906172:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822912 00000100:00100000:1.0:1788836464.906180:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822912 00000100:00100000:1.0:1788836464.906220:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823424 00000100:00100000:1.0:1788836464.906223:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823424 00000100:00100000:1.0:1788836464.906469:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823936 00000100:00100000:1.0:1788836464.906472:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823936 00000100:00100000:1.0:1788836464.906485:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823296 00000100:00100000:1.0:1788836464.906487:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823296 00000100:00100000:1.0:1788836464.906497:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823808 00000100:00100000:1.0:1788836464.906499:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823808 00000100:00100000:1.0:1788836464.906509:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823040 00000100:00100000:1.0:1788836464.906512:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823040 00000100:00100000:1.0:1788836464.906526:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788836464.906533:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782822912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906599:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782822912:12345-0@lo:400:kworker.0 Request processed in 65us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906606:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788836464.906625:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836464.906631:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782823424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906671:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782823424:12345-0@lo:400:kworker.0 Request processed in 28us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906678:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836464.906689:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788836464.906694:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782823936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906721:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782823936:12345-0@lo:400:kworker.0 Request processed in 27us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906727:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788836464.906738:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788836464.906744:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782823296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906770:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782823296:12345-0@lo:400:kworker.0 Request processed in 26us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906775:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788836464.906786:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788836464.906791:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782823808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906816:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782823808:12345-0@lo:400:kworker.0 Request processed in 26us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906822:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788836464.906832:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788836464.906838:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782823040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906879:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782823040:12345-0@lo:400:kworker.0 Request processed in 41us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906885:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788836464.906913:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782822784 00000100:00100000:1.0:1788836464.906917:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782822784 00000100:00100000:1.0:1788836464.906943:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788836464.906951:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782822784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.906981:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782822784:12345-0@lo:400:kworker.0 Request processed in 31us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.906986:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788836464.907595:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823168 00000100:00100000:1.0:1788836464.907602:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823168 00000100:00100000:1.0:1788836464.907639:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788836464.907646:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782823168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.907703:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782823168:12345-0@lo:400:kworker.0 Request processed in 56us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.907710:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788836464.907735:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823680 00000100:00100000:1.0:1788836464.907739:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823680 00000100:00100000:1.0:1788836464.907767:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782823552 00000100:00100000:1.0:1788836464.907770:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782823552 00000100:00100000:1.0:1788836464.907781:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824064 00000100:00100000:1.0:1788836464.907783:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824064 00000100:00100000:1.0:1788836464.907798:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836464.907804:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782823680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.907836:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782823680:12345-0@lo:400:kworker.0 Request processed in 32us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.907856:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836464.907986:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836464.907993:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782823552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908048:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782823552:12345-0@lo:400:kworker.0 Request processed in 56us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.908055:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836464.908068:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836464.908074:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782824064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908179:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782824064:12345-0@lo:400:kworker.0 Request processed in 104us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836464.908185:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788836464.908228:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836464.908233:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836464.908235:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836464.908266:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782822784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908283:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782823296:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908294:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782823808:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908305:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782822912:0@lo:400:kworker.0 00010000:00080000:1.0:1788836464.908319:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebd880 x1875730782823424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836464.908335:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782823424:0@lo:400:kworker.0 00010000:00080000:1.0:1788836464.908346:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920380 x1875730782823936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836464.908367:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908410:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782823040:0@lo:400:kworker.0 00010000:00080000:1.0:1788836464.908421:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebf100 x1875730782823552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836464.908428:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782823552:0@lo:400:kworker.0 00010000:00080000:1.0:1788836464.908439:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43922300 x1875730782824064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836464.908447:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782824064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836464.908456:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782823168:0@lo:400:kworker.0 00010000:00080000:1.0:1788836464.908465:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebc700 x1875730782823680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836464.908472:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782823680:0@lo:400:kworker.0 00010000:00010000:1.0:1788836465.026294:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836465.057716:0:10924:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing yml_node 00000100:00100000:0.0:1788836465.407317:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836465.407406:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782824192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836465.407475:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836465.407687:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824192 00000100:00100000:0.0:1788836465.407695:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824192 00000100:00100000:0.0:1788836465.407979:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788836465.407990:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782824192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836465.408054:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836465.408108:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782824192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836465.408116:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788836465.408228:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43891880 x1875730782824192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836465.408248:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782824192:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836466.052895:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836467.074952:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836467.455382:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782824320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836467.455453:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836467.455660:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824320 00000100:00100000:3.0:1788836467.455669:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824320 00000100:00100000:3.0:1788836467.455722:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836467.455731:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782824320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836467.455765:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836467.455826:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782824320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836467.455834:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788836467.455940:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782824320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836467.656973:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836467.657086:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836467.657120:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836467.657207:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174464 00000100:00100000:3.0:1788836467.657219:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174464 00000100:00100000:3.0:1788836467.657281:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174336 00000100:00100000:3.0:1788836467.657285:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174336 00000100:00100000:3.0:1788836467.657312:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1788836467.657321:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770174464:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836467.657408:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770174464:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836467.657415:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1788836467.657433:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:3.0:1788836467.657440:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770174336:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836467.657498:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770174336:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 57us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836467.657505:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:3.0:1788836467.658652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836467.658868:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00080000:2.0:1788836467.659268:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836467.659274:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836467.659370:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174592 00000100:00100000:1.0:1788836467.659380:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174592 00000100:00100000:1.0:1788836467.659949:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174720 00000100:00100000:1.0:1788836467.659955:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174720 00000100:00080000:2.0:1788836467.660095:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836467.660099:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836467.660177:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174208 00000100:00100000:0.0:1788836467.660183:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174208 00000100:00100000:0.0:1788836467.660218:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 280 00000100:00100000:0.0:1788836467.660227:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770174208:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836467.660295:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770174208:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836467.660302:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 280 00000100:00100000:1.0:1788836467.662283:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788836467.662303:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2393:x1875730770174592:12345-192.168.201.38@tcp:9:kworker.0 00000100:00100000:3.0:1788836467.662319:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836467.662332:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2393:x1875730770174720:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788836467.662344:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553fa9 00000100:00080000:1.0:1788836467.662357:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8adf81458000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788836467.662358:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553fb0 00000100:00080000:3.0:1788836467.662370:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8ade42528800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836467.662425:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788836467.662593:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+2:2393:x1875730770174592:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 297us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836467.662601:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000001:00000004:3.0:1788836467.663170:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788836467.663248:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836467.663359:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+2:2393:x1875730770174720:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 1028us (4488us total) trans 0 rc 0/0 00010000:00010000:1.0:1788836467.663364:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836467.663370:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:1.0:1788836468.094344:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836468.480514:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836468.480538:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782824448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836468.480633:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836468.480700:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824448 00000100:00100000:3.0:1788836468.480707:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824448 00000100:00100000:3.0:1788836468.480757:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836468.480766:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782824448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836468.480795:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836468.480848:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782824448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836468.480855:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788836468.480878:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836468.480915:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5c00 x1875730782824448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836468.480942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782824448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836468.489165:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782824576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836468.489238:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836468.489306:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824576 00000100:00100000:3.0:1788836468.489314:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824576 00000100:00100000:3.0:1788836468.489368:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836468.489378:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782824576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836468.489402:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836468.489448:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782824576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836468.489457:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788836468.489495:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836468.489527:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fe680 x1875730782824576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836468.489546:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782824576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788836469.121681:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836469.183415:0:11108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.113 00000100:00100000:1.0:1788836469.502384:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782824704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836469.502464:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836469.502647:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824704 00000100:00100000:3.0:1788836469.502658:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824704 00000100:00100000:3.0:1788836469.502721:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788836469.502732:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782824704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836469.502769:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836469.502843:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782824704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836469.502851:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836469.503072:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782824704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836470.014343:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836470.014373:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782824832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836470.014454:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836470.014527:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824832 00000100:00100000:3.0:1788836470.014536:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824832 00000100:00100000:3.0:1788836470.014600:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836470.014609:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782824832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836470.014640:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836470.014687:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782824832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836470.014703:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788836470.014724:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788836470.014754:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fdf80 x1875730782824832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836470.014774:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782824832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836470.017384:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782825088:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.017444:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836470.017495:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782825600:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.017519:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836470.017544:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825088 00000100:00100000:3.0:1788836470.017552:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825088 00000100:00100000:3.0:1788836470.017606:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825600 00000100:00100000:3.0:1788836470.017610:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825600 00000100:00100000:3.0:1788836470.017690:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836470.017709:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782825088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836470.017769:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782825088:12345-0@lo:400:kworker.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836470.017776:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836470.017791:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836470.017797:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836470.017822:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782825600:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836470.017836:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788836470.018119:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788836470.018531:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20700 x1875730782825600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836470.018547:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782825600:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.018553:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782826112:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.018592:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836470.018748:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782825088:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.018759:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788836470.018767:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782825216:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.018791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836470.021429:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782825344:0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021500:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836470.021535:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782825856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836470.021609:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788836470.021616:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782824960:0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021648:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836470.021675:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782825472:0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021712:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825344 00000100:00100000:1.0:1788836470.021720:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825344 00000100:00100000:1.0:1788836470.021767:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836470.021776:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782825344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021833:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782825344:12345-0@lo:400:kworker.0 Request processed in 58us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.021841:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836470.021864:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825856 00000100:00100000:1.0:1788836470.021867:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825856 00000100:00100000:1.0:1788836470.021919:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836470.021925:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782825856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.021958:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782825856:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.021964:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836470.021982:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782824960 00000100:00100000:1.0:1788836470.021985:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782824960 00000100:00100000:1.0:1788836470.022040:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788836470.022047:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782824960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.022080:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782824960:12345-0@lo:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.022088:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1788836470.022113:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836470.022423:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782825728:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.022452:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836470.022470:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782826240:0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.022489:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836470.022601:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826112 00000100:00100000:3.0:1788836470.022606:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826112 00000100:00100000:3.0:1788836470.022642:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825216 00000100:00100000:3.0:1788836470.022645:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825216 00000100:00100000:3.0:1788836470.022662:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836470.022668:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782826112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.022789:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788836470.022798:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782825216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836470.022837:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782825216:12345-0@lo:400:kworker.0 Request processed in 41us (4044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836470.022843:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788836470.022946:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782826112:12345-0@lo:400:kworker.0 Request processed in 278us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836470.022953:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836470.027314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825728 00000100:00100000:0.0:1788836470.027328:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825728 00000100:00080000:1.0:1788836470.027464:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836470.027470:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836470.027669:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826240 00000100:00100000:0.0:1788836470.027674:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826240 00000100:00080000:3.0:1788836470.027730:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836470.030545:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836470.030565:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782825728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.030779:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782825728:12345-0@lo:400:kworker.0 Request processed in 221us (8325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.030785:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836470.030808:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836470.030816:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782826240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.030848:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782826240:12345-0@lo:400:kworker.0 Request processed in 34us (8358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.030855:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836470.031046:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836470.031088:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782825984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836470.031118:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782825216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788836470.031145:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc21f80 x1875730782825728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836470.031155:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782825728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031156:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782825344:0@lo:400:kworker.0 00010000:00080000:1.0:1788836470.031166:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b68000 x1875730782826240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788836470.031168:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc22d80 x1875730782825856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836470.031175:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782826240:0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031176:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782825856:0@lo:400:kworker.0 00010000:00080000:1.0:1788836470.031185:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20e00 x1875730782826112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836470.031193:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782826112:0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031195:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782824960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031214:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825472 00000100:00100000:2.0:1788836470.031220:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825472 00000100:00100000:2.0:1788836470.031270:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782825984 00000100:00100000:2.0:1788836470.031274:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782825984 00000100:00100000:2.0:1788836470.031293:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788836470.031299:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782825472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031338:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782825472:12345-0@lo:400:kworker.0 Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836470.031345:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836470.031349:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788836470.031358:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836470.031373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782825472:0@lo:400:kworker.0 00000100:00080000:1.0:1788836470.031418:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836470.031544:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782825984:12345-0@lo:400:kworker.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836470.031551:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836470.031675:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782825984:0@lo:400:kworker.0 00010000:00010000:2.0:1788836470.150194:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836470.526605:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836470.526631:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782826368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836470.526703:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836470.526819:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826368 00000100:00100000:1.0:1788836470.526827:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826368 00000100:00100000:1.0:1788836470.526891:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836470.526902:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782826368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836470.526928:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836470.526981:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782826368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836470.527001:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788836470.527238:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43890e00 x1875730782826368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836470.527258:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782826368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836471.166262:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836471.647801:0:11205:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.113 00010000:00010000:1.0:1788836472.197562:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836472.575652:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836472.575761:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836472.575865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836472.575956:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826496 00000100:00100000:0.0:1788836472.575966:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826496 00000100:00100000:0.0:1788836472.577756:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836472.577784:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782826496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836472.577842:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836472.577953:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782826496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836472.577961:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836472.580373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836472.769509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836472.769557:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836472.769594:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836472.769637:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175104 00000100:00100000:0.0:1788836472.769651:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175104 00000100:00100000:0.0:1788836472.769727:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174976 00000100:00100000:0.0:1788836472.769730:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174976 00000100:00100000:0.0:1788836472.769756:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788836472.769767:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770175104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836472.769870:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770175104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836472.769891:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788836472.769912:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:0.0:1788836472.769918:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770174976:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836472.769942:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770174976:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836472.769948:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00080000:0.0:1788836472.769964:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836472.769968:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836472.771601:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770174848 00000100:00100000:1.0:1788836472.771634:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770174848 00000100:00100000:1.0:1788836472.771718:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 282 00000100:00100000:1.0:1788836472.771729:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2394:x1875730770174848:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836472.771839:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2394:x1875730770174848:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 112us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836472.771848:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 282 00000001:00100000:3.0:1788836473.090952:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:3.0:1788836473.090968:0:8401:0:(genops.c:885:class_export_put()) final put ffff8adf81459000/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000001:00100000:1.0:1788836473.093385:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:1.0:1788836473.093402:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf8145d800/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:0.0:1788836473.098113:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf81459000/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-OST0000 00000020:00000080:0.0:1788836473.098333:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf8145d800/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-OST0001 00000020:00000080:0.0:1788836473.098362:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf81458000 for lustre-OST0000 00000020:00000080:0.0:1788836473.098369:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42528800 for lustre-OST0001 00010000:00010000:2.0:1788836473.222367:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836473.598222:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782826624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836473.598300:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836473.598761:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836473.598771:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782826752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836473.598800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836473.598918:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826624 00000100:00100000:0.0:1788836473.598927:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826624 00000100:00100000:0.0:1788836473.599003:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826752 00000100:00100000:0.0:1788836473.599006:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826752 00000100:00100000:0.0:1788836473.599053:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836473.599063:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782826624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836473.599094:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836473.599144:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782826624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836473.599151:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836473.599169:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788836473.599176:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782826752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836473.599186:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836473.599226:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782826752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836473.599232:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788836473.599288:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836473.599320:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b68380 x1875730782826752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836473.599339:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782826752:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788836473.599350:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fc380 x1875730782826624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836473.599361:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782826624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788836474.248948:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836474.624986:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836474.625038:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782826880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836474.625107:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836474.625368:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782826880 00000100:00100000:1.0:1788836474.625377:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782826880 00000100:00100000:1.0:1788836474.625424:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836474.625433:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782826880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836474.625467:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788836474.625530:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782826880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836474.625548:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836474.625605:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782826880:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788836474.753741:0:11303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.113 00000100:00100000:0.0:1788836475.134724:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836475.134744:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782827008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836475.134806:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836475.135084:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827008 00000100:00100000:3.0:1788836475.135101:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827008 00000100:00100000:3.0:1788836475.135151:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836475.135158:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782827008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836475.135183:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836475.135219:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782827008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836475.135223:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788836475.135271:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788836475.135294:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fdc00 x1875730782827008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836475.135307:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782827008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836475.135658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782827392:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135697:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782827904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135711:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135721:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782828416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135748:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836475.135751:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782827520:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135773:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135786:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135800:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828544:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836475.135843:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827904 00000100:00100000:0.0:1788836475.135847:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827904 00000100:00100000:0.0:1788836475.135901:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828416 00000100:00100000:0.0:1788836475.135915:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828416 00000100:00100000:0.0:1788836475.135934:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827520 00000100:00100000:0.0:1788836475.135936:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827520 00000100:00100000:0.0:1788836475.135945:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836475.135949:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782827904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.135978:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782827904:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.135982:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836475.135991:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836475.135994:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782828416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.136031:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782828416:12345-0@lo:400:kworker.0 Request processed in 14us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.136035:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836475.136042:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788836475.136046:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782827520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.136062:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782827520:12345-0@lo:400:kworker.0 Request processed in 17us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.136065:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788836475.136078:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828032 00000100:00100000:0.0:1788836475.136080:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828032 00000100:00100000:0.0:1788836475.136094:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828544 00000100:00100000:0.0:1788836475.136095:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828544 00000100:00100000:0.0:1788836475.136105:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788836475.136108:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.136125:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828032:12345-0@lo:400:kworker.0 Request processed in 16us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.136136:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788836475.136143:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836475.136146:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.136164:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828544:12345-0@lo:400:kworker.0 Request processed in 17us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.136167:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788836475.136181:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836475.136183:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836475.136185:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836475.136196:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782827520:0@lo:400:kworker.0 00010000:00080000:0.0:1788836475.136203:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7aca80 x1875730782828032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836475.136208:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828032:0@lo:400:kworker.0 00010000:00080000:0.0:1788836475.136213:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f8700 x1875730782828544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836475.136218:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828544:0@lo:400:kworker.0 00010000:00080000:0.0:1788836475.136223:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444ff480 x1875730782827904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836475.136227:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782827904:0@lo:400:kworker.0 00010000:00080000:0.0:1788836475.136231:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7af480 x1875730782828416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836475.136235:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782828416:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136456:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782827136:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136500:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136535:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782827648:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136569:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136588:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782828160:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136615:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136630:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788836475.136633:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782827264:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136654:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782827776:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136664:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136672:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782828288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136682:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.136697:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828160 00000100:00100000:2.0:1788836475.136700:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828160 00000100:00100000:2.0:1788836475.136718:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836475.136722:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782828160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136746:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782828160:12345-0@lo:400:kworker.0 Request processed in 24us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.136750:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836475.136765:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827392 00000100:00100000:2.0:1788836475.136768:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827392 00000100:00100000:2.0:1788836475.136782:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827648 00000100:00100000:2.0:1788836475.136783:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827648 00000100:00100000:2.0:1788836475.136790:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836475.136794:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782827392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136825:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782827392:12345-0@lo:400:kworker.0 Request processed in 29us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.136831:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836475.136850:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836475.136855:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782827648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136896:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782827648:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.136910:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836475.136930:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827264 00000100:00100000:2.0:1788836475.136932:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827264 00000100:00100000:2.0:1788836475.136946:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827776 00000100:00100000:2.0:1788836475.136948:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827776 00000100:00100000:2.0:1788836475.136954:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828288 00000100:00100000:2.0:1788836475.136955:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828288 00000100:00100000:2.0:1788836475.136962:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836475.136966:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782827264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.136986:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782827264:12345-0@lo:400:kworker.0 Request processed in 20us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.136989:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836475.136995:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836475.136998:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782827776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.137030:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782827776:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.137034:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836475.137040:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788836475.137044:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782828288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.137059:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782828288:12345-0@lo:400:kworker.0 Request processed in 15us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.137062:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788836475.137076:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836475.137083:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836475.137103:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782827264:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.137108:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782827776:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.137113:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782828288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.137119:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782827648:0@lo:400:kworker.0 00010000:00080000:2.0:1788836475.137125:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7ae300 x1875730782828160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836475.137131:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782828160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.137787:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782827136 00000100:00100000:0.0:1788836475.137802:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782827136 00000100:00100000:0.0:1788836475.137847:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788836475.137854:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782827136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836475.138068:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782827136:12345-0@lo:400:kworker.0 Request processed in 215us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836475.138073:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788836475.138107:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782827392:0@lo:400:kworker.0 00000100:00100000:2.0:1788836475.139741:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782827136:0@lo:400:kworker.0 00010000:00010000:1.0:1788836475.270056:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836475.646771:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836475.646795:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836475.646875:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836475.646950:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828672 00000100:00100000:2.0:1788836475.646957:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828672 00000100:00100000:2.0:1788836475.647000:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836475.647009:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782828672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836475.647056:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836475.647099:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782828672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836475.647107:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788836475.647145:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43890a80 x1875730782828672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836475.647162:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782828672:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788836476.229515:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:01:14 EDT 2026 00010000:00010000:1.0:1788836476.295718:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836477.311122:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836477.694352:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782828800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836477.694434:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836477.694553:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828800 00000100:00100000:1.0:1788836477.694561:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828800 00000100:00100000:1.0:1788836477.694628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836477.694638:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782828800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836477.694676:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836477.703510:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782828800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8863us (9066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836477.703529:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836477.715756:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782828800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836477.893380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836477.893451:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836477.893491:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836477.893532:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175232 00000100:00100000:0.0:1788836477.893546:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175232 00000100:00100000:0.0:1788836477.893613:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 284 00000100:00100000:0.0:1788836477.893626:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2394:x1875730770175232:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836477.893734:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2394:x1875730770175232:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 110us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836477.893742:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 284 00000100:00100000:0.0:1788836477.893784:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175360 00000100:00100000:0.0:1788836477.893789:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175360 00000100:00100000:0.0:1788836477.893829:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175488 00000100:00100000:0.0:1788836477.893832:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175488 00000100:00100000:0.0:1788836477.893966:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1788836477.893978:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770175360:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836477.894039:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770175360:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 64us (675us total) trans 0 rc 0/0 00000100:00080000:1.0:1788836477.897823:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836477.897839:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836477.908711:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1788836477.909414:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:2.0:1788836477.910505:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770175488:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836477.911811:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770175488:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 3069us (18306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836477.911830:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00010000:00010000:1.0:1788836478.343545:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836478.720145:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836478.720247:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836478.720355:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782828928 00000100:00100000:3.0:1788836478.720365:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782828928 00000100:00100000:3.0:1788836478.720446:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836478.720460:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836478.720500:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836478.720553:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782828928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836478.720561:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788836478.720626:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439ff800 x1875730782828928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836478.720649:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782828928:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788836478.720906:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836478.721517:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782829056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836478.721565:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836478.730774:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829056 00000100:00100000:3.0:1788836478.730799:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829056 00000100:00100000:3.0:1788836478.730911:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836478.730925:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782829056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836478.730996:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836478.731137:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782829056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (9570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836478.731145:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788836478.731206:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77368000 x1875730782829056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836478.731231:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782829056:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788836478.732702:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788836479.368166:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836479.744157:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836479.744190:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782829184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836479.744445:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836479.745440:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829184 00000100:00100000:0.0:1788836479.745454:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829184 00000100:00100000:0.0:1788836479.745533:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836479.745545:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782829184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836479.745607:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788836479.745689:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782829184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836479.745697:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836479.745762:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782829184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836480.256681:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782829312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836480.256779:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836480.257351:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829312 00000100:00100000:3.0:1788836480.257365:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829312 00000100:00100000:3.0:1788836480.257451:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836480.257464:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782829312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836480.257503:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836480.257565:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782829312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836480.257572:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788836480.257980:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fd180 x1875730782829312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836480.258003:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782829312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788836480.258240:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836480.262247:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782829440:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262422:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782829952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262452:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262473:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782830464:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262498:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262529:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836480.262534:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782829568:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262594:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782830080:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262616:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262633:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782830592:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.262651:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.262701:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829440 00000100:00100000:0.0:1788836480.262711:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829440 00000100:00100000:0.0:1788836480.262768:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788836480.262779:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782829440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.263193:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830464 00000100:00100000:2.0:1788836480.263199:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830464 00000100:00100000:2.0:1788836480.263257:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788836480.263267:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782830464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.263326:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782830464:12345-0@lo:400:kworker.0 Request processed in 61us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.263335:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788836480.263367:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836480.263413:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc22680 x1875730782830464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836480.263431:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782830464:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.263551:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782829440:12345-0@lo:400:kworker.0 Request processed in 772us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836480.263559:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788836480.263709:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829952 00000100:00100000:0.0:1788836480.263714:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829952 00000100:00100000:0.0:1788836480.263745:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788836480.263752:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782829952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.263961:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782829952:12345-0@lo:400:kworker.0 Request processed in 39us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836480.263969:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788836480.263993:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829568 00000100:00100000:0.0:1788836480.263998:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829568 00000100:00100000:0.0:1788836480.264053:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830080 00000100:00100000:0.0:1788836480.264057:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830080 00000100:00100000:0.0:1788836480.264080:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830592 00000100:00100000:0.0:1788836480.264083:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830592 00000100:00100000:0.0:1788836480.264100:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836480.264106:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782829568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.264144:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782829568:12345-0@lo:400:kworker.0 Request processed in 38us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836480.264151:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836480.264163:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836480.264170:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782830080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.264198:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782830080:12345-0@lo:400:kworker.0 Request processed in 29us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836480.264218:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836480.265329:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836480.265352:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782830592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.265430:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782830592:12345-0@lo:400:kworker.0 Request processed in 82us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.265437:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788836480.265984:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782829696:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266052:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266089:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782830208:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266115:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266132:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782830720:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266172:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266202:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788836480.266210:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782829824:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266232:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266248:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782830336:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266270:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266287:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782830848:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.266308:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836480.266336:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830208 00000100:00100000:0.0:1788836480.266345:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830208 00000100:00100000:2.0:1788836480.269729:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830720 00000100:00100000:2.0:1788836480.269750:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830720 00000100:00100000:2.0:1788836480.269846:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829824 00000100:00100000:2.0:1788836480.269849:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829824 00000100:00100000:2.0:1788836480.269874:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836480.269886:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270039:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782830720:12345-0@lo:400:kworker.0 Request processed in 154us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.270047:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836480.270067:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788836480.270074:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782829824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270105:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782829824:12345-0@lo:400:kworker.0 Request processed in 33us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.270111:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788836480.270144:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782829696 00000100:00100000:2.0:1788836480.270148:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782829696 00000100:00100000:2.0:1788836480.270177:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836480.270183:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782829696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270218:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782829696:12345-0@lo:400:kworker.0 Request processed in 35us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.270223:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836480.270258:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830336 00000100:00100000:2.0:1788836480.270263:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830336 00000100:00100000:2.0:1788836480.270302:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830848 00000100:00100000:2.0:1788836480.270306:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830848 00000100:00100000:2.0:1788836480.270328:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836480.270335:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782830336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270370:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782830336:12345-0@lo:400:kworker.0 Request processed in 36us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.270376:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836480.270387:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836480.270403:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782830848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270436:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782830848:12345-0@lo:400:kworker.0 Request processed in 43us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.270442:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788836480.270471:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836480.270476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836480.270479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836480.270482:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836480.270533:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782829824:0@lo:400:kworker.0 00010000:00080000:2.0:1788836480.270552:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebf100 x1875730782830336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836480.270563:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782830336:0@lo:400:kworker.0 00010000:00080000:2.0:1788836480.270574:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20a80 x1875730782830848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836480.270596:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782830848:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270608:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782829696:0@lo:400:kworker.0 00010000:00080000:2.0:1788836480.270619:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20e00 x1875730782830720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836480.270635:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782830720:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270688:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782829568:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270704:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782830080:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270718:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782830592:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782829440:0@lo:400:kworker.0 00000100:00100000:2.0:1788836480.270743:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782829952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.271977:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788836480.271996:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782830208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836480.272105:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782830208:12345-0@lo:400:kworker.0 Request processed in 117us (5989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836480.272112:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1788836480.272950:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebfb80 x1875730782830208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836480.272969:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782830208:0@lo:400:kworker.0 00010000:00010000:1.0:1788836480.385076:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836480.768449:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836480.768483:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782830976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836480.768592:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836480.769142:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782830976 00000100:00100000:2.0:1788836480.769155:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782830976 00000100:00100000:2.0:1788836480.769235:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836480.769248:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782830976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836480.769281:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836480.769365:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782830976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836480.769373:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788836480.769576:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77368000 x1875730782830976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836480.769611:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782830976:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836481.408077:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836482.440660:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836482.815412:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782831104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836482.815511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836482.815772:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831104 00000100:00100000:0.0:1788836482.815783:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831104 00000100:00100000:0.0:1788836482.815843:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788836482.815853:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782831104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836482.815904:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836482.815967:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782831104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836482.815975:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788836482.816077:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782831104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836483.012985:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836483.013051:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836483.013100:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836483.013130:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175744 00000100:00100000:2.0:1788836483.013143:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175744 00000100:00100000:2.0:1788836483.013213:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175872 00000100:00100000:2.0:1788836483.013217:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175872 00000100:00100000:2.0:1788836483.013240:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:2.0:1788836483.013250:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770175744:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836483.013327:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770175744:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836483.013335:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:2.0:1788836483.013364:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:2.0:1788836483.013371:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770175872:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836483.013399:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770175872:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836483.013406:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00080000:2.0:1788836483.013424:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836483.013428:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836483.014365:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770175616 00000100:00100000:0.0:1788836483.014373:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770175616 00000100:00100000:0.0:1788836483.014420:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 286 00000100:00100000:0.0:1788836483.014428:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770175616:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836483.014476:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770175616:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 49us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836483.014483:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 286 00010000:00010000:1.0:1788836483.455036:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836483.842528:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782831232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836483.842606:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836483.842670:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836483.842678:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782831360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836483.842703:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836483.842890:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831232 00000100:00100000:2.0:1788836483.842900:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831232 00000100:00100000:2.0:1788836483.842953:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831360 00000100:00100000:2.0:1788836483.842956:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831360 00000100:00100000:2.0:1788836483.842972:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836483.842981:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782831232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836483.843030:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836483.843078:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782831232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836483.843092:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836483.843112:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836483.843117:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782831360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836483.843128:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836483.843154:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782831360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836483.843160:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788836483.843179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836483.843213:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fd500 x1875730782831360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836483.843232:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782831360:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788836483.843243:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fd180 x1875730782831232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836483.843253:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782831232:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788836484.494091:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836484.862172:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836484.862198:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782831488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836484.862273:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.864888:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831488 00000100:00100000:3.0:1788836484.864903:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831488 00000100:00100000:3.0:1788836484.865029:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788836484.865041:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782831488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836484.865087:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836484.865198:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782831488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836484.865217:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836484.865322:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782831488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836485.375287:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782831616:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375380:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375431:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782832128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375458:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375491:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782832640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375514:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782833152:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375564:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375590:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788836485.375597:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782832000:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375619:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375638:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782832512:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375657:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375674:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782833024:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.375693:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.375721:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782831744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.376862:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.376985:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782832256:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377068:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782832768:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377090:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377132:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782833280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836485.377156:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377176:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788836485.377182:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782831872:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377217:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377239:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782832384:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377260:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377275:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782832896:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377296:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.377340:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831616 00000100:00100000:3.0:1788836485.377348:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831616 00000100:00100000:3.0:1788836485.377391:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788836485.377400:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782831616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377453:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782831616:12345-0@lo:400:kworker.0 Request processed in 54us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836485.377460:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788836485.377492:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832128 00000100:00100000:3.0:1788836485.377496:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832128 00000100:00100000:3.0:1788836485.377518:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831872 00000100:00100000:3.0:1788836485.377521:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831872 00000100:00100000:3.0:1788836485.377534:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836485.377540:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377575:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782832128:12345-0@lo:400:kworker.0 Request processed in 35us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836485.377581:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836485.377593:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836485.377598:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782831872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.377641:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782831872:12345-0@lo:400:kworker.0 Request processed in 43us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836485.377648:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836485.377665:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832640 00000100:00100000:3.0:1788836485.377668:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832640 00000100:00100000:3.0:1788836485.377695:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833152 00000100:00100000:3.0:1788836485.377698:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833152 00000100:00100000:3.0:1788836485.377708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832512 00000100:00100000:3.0:1788836485.377710:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832512 00000100:00100000:3.0:1788836485.377720:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833024 00000100:00100000:3.0:1788836485.377722:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833024 00000100:00100000:0.0:1788836485.378075:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832000 00000100:00100000:0.0:1788836485.378080:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832000 00000100:00100000:0.0:1788836485.378104:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782831744 00000100:00100000:0.0:1788836485.378107:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782831744 00000100:00100000:0.0:1788836485.378117:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832256 00000100:00100000:0.0:1788836485.378120:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832256 00000100:00100000:0.0:1788836485.378132:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832768 00000100:00100000:0.0:1788836485.378134:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832768 00000100:00100000:0.0:1788836485.378145:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832384 00000100:00100000:0.0:1788836485.378147:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832384 00000100:00100000:0.0:1788836485.378157:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782832896 00000100:00100000:0.0:1788836485.378160:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782832896 00000100:00100000:0.0:1788836485.378173:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788836485.378180:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782832000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378223:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782832000:12345-0@lo:400:kworker.0 Request processed in 43us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378229:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788836485.378253:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836485.378259:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378290:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782831744:12345-0@lo:400:kworker.0 Request processed in 32us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378296:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836485.378319:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836485.378326:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782832256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378353:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782832256:12345-0@lo:400:kworker.0 Request processed in 28us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378360:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836485.378371:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788836485.378377:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782832768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378403:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782832768:12345-0@lo:400:kworker.0 Request processed in 27us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378409:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788836485.378419:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788836485.378425:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782832384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378450:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782832384:12345-0@lo:400:kworker.0 Request processed in 26us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378456:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788836485.378477:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788836485.378484:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782832896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.378510:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782832896:12345-0@lo:400:kworker.0 Request processed in 27us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.378515:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788836485.381380:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833280 00000100:00100000:0.0:1788836485.381394:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833280 00000100:00100000:0.0:1788836485.381455:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836485.381474:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782833280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836485.381508:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836485.381597:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782833280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.381605:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836485.381636:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836485.381645:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782832640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.381684:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782832640:12345-0@lo:400:kworker.0 Request processed in 41us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.381690:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836485.381705:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836485.381711:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782833152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.381755:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782833152:12345-0@lo:400:kworker.0 Request processed in 44us (6189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.381761:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836485.381773:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836485.381781:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.381812:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782832512:12345-0@lo:400:kworker.0 Request processed in 31us (6153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.381817:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788836485.383343:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836485.383353:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836485.383356:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836485.383358:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836485.383407:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782832000:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.383425:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fca80 x1875730782832512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.383435:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782832512:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.383446:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782831616:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.383456:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782832128:0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.384351:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836485.384368:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782833024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836485.384449:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782833024:12345-0@lo:400:kworker.0 Request processed in 89us (8755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.384467:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788836485.384662:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fc380 x1875730782832640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.384674:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782832640:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.384693:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f2300 x1875730782833152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.384714:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782833152:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.386005:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5c00 x1875730782833024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.386034:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782833024:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.386083:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782831872:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.386097:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fdc00 x1875730782832384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.386107:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782832384:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.386120:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fe680 x1875730782832896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.386129:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782832896:0@lo:400:kworker.0 00010000:00080000:3.0:1788836485.386140:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc27100 x1875730782833280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836485.386158:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782833280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836485.386172:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782831744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.386183:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782832256:0@lo:400:kworker.0 00000100:00100000:3.0:1788836485.386207:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782832768:0@lo:400:kworker.0 00010000:00010000:0.0:1788836485.504227:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836485.886604:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836485.886629:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782833408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836485.886703:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836485.886867:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833408 00000100:00100000:2.0:1788836485.886877:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833408 00000100:00100000:2.0:1788836485.886937:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836485.886948:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782833408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836485.886970:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836485.887047:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782833408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836485.887055:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788836485.887130:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebfb80 x1875730782833408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836485.887148:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782833408:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836486.526230:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836487.551856:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836487.934327:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782833536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836487.934407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836487.934601:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833536 00000100:00100000:0.0:1788836487.934611:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833536 00000100:00100000:0.0:1788836487.934670:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836487.934680:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782833536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836487.934728:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836487.934776:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782833536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836487.934783:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836487.934954:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782833536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836488.135467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836488.135518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836488.135539:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836488.135765:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176128 00000100:00100000:3.0:1788836488.135775:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176128 00000100:00100000:3.0:1788836488.135832:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176256 00000100:00100000:3.0:1788836488.135834:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176256 00000100:00100000:3.0:1788836488.135856:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1788836488.135864:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770176128:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836488.135936:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770176128:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 72us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836488.135943:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1788836488.135959:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1788836488.135965:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770176256:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836488.135989:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770176256:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836488.135995:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:1.0:1788836488.136075:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176000 00000100:00100000:1.0:1788836488.136080:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176000 00000100:00100000:1.0:1788836488.136120:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 288 00000100:00100000:1.0:1788836488.136127:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770176000:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836488.136154:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770176000:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836488.136160:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 288 00000100:00080000:2.0:1788836488.136276:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836488.136281:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836488.577662:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836488.958199:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782833664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836488.958287:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836488.958364:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833664 00000100:00100000:3.0:1788836488.958372:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833664 00000100:00100000:3.0:1788836488.958415:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836488.958421:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782833664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836488.958443:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836488.958475:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782833664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836488.958480:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788836488.958502:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836488.958527:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f2680 x1875730782833664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836488.958542:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782833664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836488.958698:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836488.958709:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782833792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836488.958738:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836488.958769:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833792 00000100:00100000:0.0:1788836488.958773:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833792 00000100:00100000:0.0:1788836488.958812:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836488.958817:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782833792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836488.958825:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836488.958847:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782833792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836488.958851:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788836488.958869:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc24380 x1875730782833792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836488.958878:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782833792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788836488.958890:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788836489.603537:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836489.983578:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782833920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836489.983666:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836489.984213:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782833920 00000100:00100000:2.0:1788836489.984233:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782833920 00000100:00100000:2.0:1788836489.984282:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788836489.984292:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782833920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836489.984340:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836489.984405:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782833920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836489.984411:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788836489.984455:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782833920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836490.494369:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782834304:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494460:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494537:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782834816:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494562:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494583:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782835328:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494601:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494627:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836490.494632:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782834432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494650:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494677:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782834944:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494715:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494736:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782835456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494755:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836490.494786:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834304 00000100:00100000:1.0:1788836490.494794:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834304 00000100:00100000:1.0:1788836490.494840:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788836490.494849:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782834304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.494905:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782834304:12345-0@lo:400:kworker.0 Request processed in 56us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836490.494912:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788836490.494947:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834816 00000100:00100000:1.0:1788836490.494951:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834816 00000100:00100000:1.0:1788836490.494982:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835328 00000100:00100000:1.0:1788836490.494984:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835328 00000100:00100000:1.0:1788836490.495000:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834432 00000100:00100000:1.0:1788836490.495003:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834432 00000100:00100000:1.0:1788836490.495046:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788836490.495054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782834816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.495085:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782834816:12345-0@lo:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836490.495099:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788836490.495115:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836490.495121:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782835328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.495150:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782835328:12345-0@lo:400:kworker.0 Request processed in 29us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836490.495155:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836490.495170:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788836490.495176:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782834432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.495202:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782834432:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836490.495207:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788836490.495265:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782834432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.495276:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782834304:0@lo:400:kworker.0 00010000:00080000:1.0:1788836490.495289:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444f8000 x1875730782834816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836490.495299:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782834816:0@lo:400:kworker.0 00010000:00080000:1.0:1788836490.495308:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a754a80 x1875730782835328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836490.495315:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782835328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495644:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782834176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495687:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495713:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782834688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495734:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495745:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782835200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495763:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495782:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788836490.495789:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782834048:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495835:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782834560:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495854:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495868:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835072:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495917:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835584:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.495939:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.495964:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834176 00000100:00100000:2.0:1788836490.495969:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834176 00000100:00100000:2.0:1788836490.495991:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834688 00000100:00100000:2.0:1788836490.495993:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834688 00000100:00100000:2.0:1788836490.496004:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835200 00000100:00100000:2.0:1788836490.496006:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835200 00000100:00100000:2.0:1788836490.496050:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788836490.496057:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782834176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.496097:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782834176:12345-0@lo:400:kworker.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836490.496104:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788836490.496117:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788836490.496123:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782834688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.496149:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782834688:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836490.496154:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788836490.496165:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788836490.496171:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782835200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.496197:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782835200:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836490.496203:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788836490.496242:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782834176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.496254:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782834688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836490.496271:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782835200:0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.496373:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834560 00000100:00100000:1.0:1788836490.496442:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834560 00000100:00100000:1.0:1788836490.496477:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788836490.496484:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836490.496525:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782834560:12345-0@lo:400:kworker.0 Request processed in 41us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836490.496531:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836490.496709:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834944 00000100:00100000:3.0:1788836490.496713:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834944 00000100:00100000:3.0:1788836490.496736:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835456 00000100:00100000:3.0:1788836490.496739:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835456 00000100:00100000:3.0:1788836490.496750:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835072 00000100:00100000:3.0:1788836490.496752:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835072 00000100:00100000:3.0:1788836490.496763:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835584 00000100:00100000:3.0:1788836490.496765:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835584 00000100:00100000:3.0:1788836490.496777:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836490.496783:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782834944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836490.496832:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782834944:12345-0@lo:400:kworker.0 Request processed in 49us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836490.496838:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836490.496850:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836490.496856:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782835456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836490.496884:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782835456:12345-0@lo:400:kworker.0 Request processed in 28us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836490.496890:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836490.496900:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836490.496905:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836490.496932:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835072:12345-0@lo:400:kworker.0 Request processed in 26us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836490.496937:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836490.496956:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836490.496961:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836490.496987:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835584:12345-0@lo:400:kworker.0 Request processed in 26us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836490.496992:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836490.497136:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782834560:0@lo:400:kworker.0 00010000:00080000:2.0:1788836490.497150:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a4380 x1875730782835072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836490.497160:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835072:0@lo:400:kworker.0 00010000:00080000:2.0:1788836490.497170:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a756680 x1875730782835584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836490.497178:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835584:0@lo:400:kworker.0 00010000:00080000:1.0:1788836490.497260:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444f8e00 x1875730782834944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836490.497268:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782834944:0@lo:400:kworker.0 00010000:00080000:1.0:1788836490.497277:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a755c00 x1875730782835456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836490.497283:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782835456:0@lo:400:kworker.0 00000100:00080000:0.0:1788836490.497428:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836490.497442:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836490.497445:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836490.497448:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836490.497463:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782834048 00000100:00100000:0.0:1788836490.497466:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782834048 00000100:00100000:0.0:1788836490.497501:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788836490.497508:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782834048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836490.497543:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782834048:12345-0@lo:400:kworker.0 Request processed in 35us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836490.497548:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788836490.497827:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836490.497859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836490.497893:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782834048:0@lo:400:kworker.0 00000100:00100000:0.0:1788836490.497988:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835712 00000100:00100000:0.0:1788836490.497992:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835712 00000100:00100000:2.0:1788836490.498092:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836490.498100:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836490.498124:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836490.498165:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782835712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836490.498171:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788836490.498246:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc27b80 x1875730782835712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836490.498260:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782835712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836490.626596:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836491.006764:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782835840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836491.006830:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836491.007310:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835840 00000100:00100000:0.0:1788836491.007330:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835840 00000100:00100000:0.0:1788836491.007379:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788836491.007389:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782835840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836491.007414:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836491.007469:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782835840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836491.007477:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788836491.007613:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d8380 x1875730782835840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836491.007633:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782835840:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788836491.646151:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836492.670210:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836493.065120:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836493.065143:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782835968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836493.065230:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836493.065300:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782835968 00000100:00100000:0.0:1788836493.065315:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782835968 00000100:00100000:0.0:1788836493.065360:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836493.065370:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782835968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836493.065405:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836493.065451:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782835968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836493.065458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836493.067223:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782835968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836493.261390:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836493.261431:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836493.261510:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836493.261537:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176384 00000100:00100000:0.0:1788836493.261546:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176384 00000100:00100000:2.0:1788836493.261692:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176512 00000100:00100000:2.0:1788836493.261697:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176512 00000100:00100000:2.0:1788836493.261745:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176640 00000100:00100000:2.0:1788836493.261749:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176640 00000100:00100000:2.0:1788836493.261779:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:2.0:1788836493.261788:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770176512:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836493.261870:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770176512:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836493.261877:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:2.0:1788836493.261895:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1788836493.261901:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770176640:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836493.261925:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770176640:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836493.261931:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:0.0:1788836493.263598:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 290 00000100:00100000:0.0:1788836493.263613:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770176384:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836493.263677:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770176384:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836493.263684:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 290 00000100:00080000:0.0:1788836493.263729:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836493.263734:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788836493.293733:0:11980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:01:31 (1788836491) === 00010000:00010000:1.0:1788836493.702059:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836494.079910:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782836096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836494.079988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836494.080498:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836096 00000100:00100000:3.0:1788836494.080507:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836096 00000100:00100000:3.0:1788836494.080572:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836494.080583:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782836096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836494.080613:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836494.080659:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782836096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.080719:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788836494.080777:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836494.080953:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782836224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836494.080993:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836494.081602:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836224 00000100:00100000:0.0:1788836494.081609:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836224 00000100:00100000:0.0:1788836494.081659:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788836494.081667:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782836224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836494.081685:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836494.081728:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782836224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.081748:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788836494.082385:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f2680 x1875730782836096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836494.082406:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782836096:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788836494.082527:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836494.082551:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc27800 x1875730782836224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836494.082564:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782836224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836494.170308:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.170410:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176768 00000100:00100000:1.0:1788836494.170435:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176768 00000100:00100000:1.0:1788836494.170493:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:1.0:1788836494.170504:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:8737:x1875730770176768:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836494.170521:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836494.170539:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993200/0xf7b38383a655409e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1c5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.170568:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993200/0xf7b38383a655409e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1c5 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.170579:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993200/0xf7b38383a655409e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1c5 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.170587:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993200, rc 0) 00000100:00100000:1.0:1788836494.170650:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770176768:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.170657:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:2.0:1788836494.180752:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.180870:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770176896 00000100:00100000:0.0:1788836494.180944:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770176896 00000100:00100000:0.0:1788836494.181195:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 292 00000100:00100000:0.0:1788836494.181207:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770176896:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836494.181414:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770176896:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 209us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.181423:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 292 00000100:00100000:2.0:1788836494.198307:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.199007:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177024 00000100:00100000:0.0:1788836494.199063:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177024 00000100:00100000:0.0:1788836494.199146:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00100000:0.0:1788836494.199186:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770177024:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788836494.199459:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770177024:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 275us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.199468:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00100000:3.0:1788836494.210204:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.213802:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177152 00000100:00100000:0.0:1788836494.213819:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177152 00000100:00100000:0.0:1788836494.213911:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 294 00000100:00100000:0.0:1788836494.213923:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177152:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836494.214158:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177152:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 228us (3960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.214166:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 294 00000100:00100000:2.0:1788836494.271301:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.271813:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177280 00000100:00100000:1.0:1788836494.271825:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177280 00000100:00100000:1.0:1788836494.271890:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00100000:1.0:1788836494.271901:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177280:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836494.275388:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177280:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 3476us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.275405:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00100000:2.0:1788836494.283714:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.284757:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177408 00000100:00100000:3.0:1788836494.284771:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177408 00000100:00100000:3.0:1788836494.284829:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 296 00000100:00100000:3.0:1788836494.284839:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177408:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836494.285000:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8741:x1875730770177408:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 161us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.285008:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 296 00000100:00100000:0.0:1788836494.294291:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.294626:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177536 00000100:00100000:1.0:1788836494.294637:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177536 00000100:00100000:1.0:1788836494.294692:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:1.0:1788836494.294703:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:8737:x1875730770177536:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836494.294735:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836494.294755:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992000/0xf7b38383a65540a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1f6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.294786:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992000/0xf7b38383a65540a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1f6 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.294798:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992000/0xf7b38383a65540a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1f6 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836494.294807:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992000, rc 0) 00000100:00100000:1.0:1788836494.294870:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:8737:x1875730770177536:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 169us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.295319:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:2.0:1788836494.304906:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.305641:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177664 00000100:00100000:3.0:1788836494.305666:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177664 00000100:00100000:3.0:1788836494.305727:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 298 00000100:00100000:3.0:1788836494.305738:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:8737:x1875730770177664:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788836494.305763:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788836494.305780:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788836494.305785:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788836494.305789:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788836494.305791:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788836494.305794:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788836494.318901:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:8737:x1875730770177664:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 13149us (13989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.318919:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 298 00000100:00100000:0.0:1788836494.324747:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836494.324858:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177792 00000100:00100000:2.0:1788836494.324870:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177792 00000100:00100000:2.0:1788836494.324928:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:2.0:1788836494.324940:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:8737:x1875730770177792:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836494.324966:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836494.324984:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa1fd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836494.325059:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836494.325072:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836494.325081:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46600, rc 0) 00000100:00100000:2.0:1788836494.325146:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8737:x1875730770177792:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 208us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836494.325162:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:2.0:1788836494.328817:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.328946:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770177920 00000100:00100000:3.0:1788836494.328956:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770177920 00000100:00100000:3.0:1788836494.329412:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 300 00000100:00100000:3.0:1788836494.329427:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8737:x1875730770177920:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788836494.329594:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8737:x1875730770177920:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 171us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.331713:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 300 00000100:00100000:2.0:1788836494.331853:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.331956:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178048 00000100:00100000:1.0:1788836494.331970:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178048 00000100:00100000:1.0:1788836494.332078:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:1.0:1788836494.332088:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8737:x1875730770178048:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788836494.332406:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8737:x1875730770178048:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 318us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.332414:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:0.0:1788836494.335755:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.335836:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178176 00000100:00100000:3.0:1788836494.335846:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178176 00000100:00100000:3.0:1788836494.335900:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 302 00000100:00100000:3.0:1788836494.335909:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8745:x1875730770178176:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836494.336238:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8745:x1875730770178176:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.336255:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 302 00000100:00100000:3.0:1788836494.339001:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.339215:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178304 00000100:00100000:1.0:1788836494.339224:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178304 00000100:00100000:1.0:1788836494.339348:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:1.0:1788836494.339359:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8745:x1875730770178304:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836494.339612:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:8745:x1875730770178304:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 254us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.339627:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:0.0:1788836494.342781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.342826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.342854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.342886:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.342919:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178432 00000100:00100000:0.0:1788836494.342928:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178432 00000100:00100000:0.0:1788836494.342966:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178688 00000100:00100000:0.0:1788836494.342971:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178688 00000100:00100000:0.0:1788836494.342979:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179072 00000100:00100000:0.0:1788836494.342981:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179072 00000100:00100000:0.0:1788836494.343002:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179200 00000100:00100000:0.0:1788836494.343005:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179200 00000100:00100000:0.0:1788836494.343070:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:0.0:1788836494.343079:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770179072:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836494.343145:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770179072:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.343165:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:0.0:1788836494.343184:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:0.0:1788836494.343190:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770179200:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836494.343217:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770179200:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.343222:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:0.0:1788836494.343236:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788836494.343240:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1875730770178432:12345-192.168.201.38@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788836494.343352:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788836494.343358:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875730770178688:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788836494.343385:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from af47d36a-929f-4c54-b0ec-8b3068716457@192.168.201.38@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788836494.343427:0:6490:0:(genops.c:1385:class_connect()) connect: client af47d36a-929f-4c54-b0ec-8b3068716457, cookie 0xf7b38383a65540b3 00000004:00100000:2.0:1788836494.343453:0:6490:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788836494.343562:0:6490:0:(import.c:65:import_set_state_nolock()) ffff8ade43968000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836494.343594:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:2393:x1875730770178688:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 235us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836494.343601:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00010000:00080000:0.0:1788836494.345533:0:10333:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from af47d36a-929f-4c54-b0ec-8b3068716457@192.168.201.38@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1788836494.345570:0:10333:0:(genops.c:1385:class_connect()) connect: client af47d36a-929f-4c54-b0ec-8b3068716457, cookie 0xf7b38383a65540ba 00000004:00100000:0.0:1788836494.345608:0:10333:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788836494.345717:0:10333:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836494.345768:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+6:2393:x1875730770178432:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 2525us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.345777:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788836494.361372:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.361482:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.369760:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836494.373466:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178816 00000100:00100000:2.0:1788836494.373498:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178816 00000100:00100000:2.0:1788836494.373584:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178560 00000100:00100000:2.0:1788836494.373587:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178560 00000100:00100000:2.0:1788836494.373619:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1788836494.373629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:0:x1875730770178816:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836494.373666:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836494.373693:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788836494.373702:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+6:0:x1875730770178560:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788836494.373720:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836494.373754:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:0:x1875730770178816:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 127us (12393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.373754:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+6:0:x1875730770178560:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 54us (12272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.373761:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788836494.374420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00080000:2.0:1788836494.374448:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836494.374453:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836494.375129:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770178944 00000100:00100000:2.0:1788836494.375138:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770178944 00000100:00100000:2.0:1788836494.375196:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836494.375205:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770178944:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836494.376852:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836494.376946:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770178944:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 1739us (7192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836494.376955:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836494.382962:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836494.384820:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179328 00000100:00100000:0.0:1788836494.384832:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179328 00000100:00100000:1.0:1788836494.385039:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788836494.385052:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179328:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788836494.385139:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179328:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 89us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.385872:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836494.387766:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.387802:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836494.387834:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.387928:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179712 00000100:00100000:0.0:1788836494.387928:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179456 00000100:00100000:1.0:1788836494.387937:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179712 00000100:00100000:0.0:1788836494.387937:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179456 00000100:00100000:1.0:1788836494.387975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788836494.387975:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179584 00000100:00100000:0.0:1788836494.387978:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179584 00000100:00100000:1.0:1788836494.387984:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179712:12345-192.168.201.38@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788836494.387995:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:0.0:1788836494.388000:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875730770179456:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788836494.388047:0:8407:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from af47d36a-929f-4c54-b0ec-8b3068716457@192.168.201.38@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1788836494.388075:0:8407:0:(genops.c:1385:class_connect()) connect: client af47d36a-929f-4c54-b0ec-8b3068716457, cookie 0xf7b38383a65540c1 00002000:00100000:0.0:1788836494.388087:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af47d36a-929f-4c54-b0ec-8b3068716457/ffff8adf7fc1d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836494.388099:0:8407:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788836494.388127:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836494.388132:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875730770179584:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788836494.388158:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from af47d36a-929f-4c54-b0ec-8b3068716457@192.168.201.38@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:3.0:1788836494.388175:0:8405:0:(genops.c:1385:class_connect()) connect: client af47d36a-929f-4c54-b0ec-8b3068716457, cookie 0xf7b38383a65540c8 00002000:00100000:3.0:1788836494.388181:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af47d36a-929f-4c54-b0ec-8b3068716457/ffff8adf7fc16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788836494.388181:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00100000:3.0:1788836494.388192:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788836494.388208:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1b000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1788836494.388231:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836494.388253:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc16000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836494.388269:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+6:2393:x1875730770179456:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 268us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.388274:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:2393:x1875730770179584:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 141us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.388276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1788836494.388279:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788836494.388339:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179712:12345-192.168.201.38@tcp:900:mount.lustre.0 Request processed in 355us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.388346:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788836494.390779:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836494.390868:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179840 00000100:00100000:1.0:1788836494.390877:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179840 00000100:00100000:1.0:1788836494.390935:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1788836494.390945:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179840:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788836494.391221:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788836494.391436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:8737:x1875730770179840:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 492us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836494.391443:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00010000:00010000:0.0:1788836494.718327:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836495.105714:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836495.105732:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782836352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836495.105817:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836495.105870:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836352 00000100:00100000:2.0:1788836495.105877:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836352 00000100:00100000:2.0:1788836495.105925:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788836495.105935:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782836352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836495.105970:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836495.106024:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782836352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836495.106030:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836495.106742:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782836352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836495.617219:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782836864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617291:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617341:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782837376:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617388:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782837888:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617407:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617430:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836495.617436:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782836480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617463:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617485:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782836992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617508:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617526:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782837504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617545:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617571:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782836608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617610:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782837120:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617630:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617648:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782837632:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617705:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788836495.617711:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782836736:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617733:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617744:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782837248:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617761:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617777:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782837760:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617796:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836495.617825:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837376 00000100:00100000:1.0:1788836495.617834:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837376 00000100:00100000:1.0:1788836495.617882:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837888 00000100:00100000:1.0:1788836495.617885:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837888 00000100:00100000:1.0:1788836495.617904:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837248 00000100:00100000:1.0:1788836495.617907:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837248 00000100:00100000:1.0:1788836495.617916:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837760 00000100:00100000:1.0:1788836495.617919:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837760 00000100:00100000:1.0:1788836495.617933:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836495.617942:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782837376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.617990:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782837376:12345-0@lo:400:kworker.0 Request processed in 49us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.617997:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836495.618050:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836495.618057:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782837888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618085:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782837888:12345-0@lo:400:kworker.0 Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618091:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836495.618104:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836495.618117:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782837248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618163:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782837248:12345-0@lo:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618169:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836495.618183:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788836495.618189:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782837760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618216:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782837760:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618221:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788836495.618239:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836480 00000100:00100000:1.0:1788836495.618243:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836480 00000100:00100000:1.0:1788836495.618268:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788836495.618275:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782836480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618303:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782836480:12345-0@lo:400:kworker.0 Request processed in 28us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618309:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788836495.618334:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836992 00000100:00100000:1.0:1788836495.618338:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836992 00000100:00100000:1.0:1788836495.618357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837504 00000100:00100000:1.0:1788836495.618359:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837504 00000100:00100000:1.0:1788836495.618369:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836608 00000100:00100000:1.0:1788836495.618372:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836608 00000100:00100000:1.0:1788836495.618380:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837120 00000100:00100000:1.0:1788836495.618382:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837120 00000100:00100000:1.0:1788836495.618392:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782837632 00000100:00100000:1.0:1788836495.618394:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782837632 00000100:00100000:1.0:1788836495.618403:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836736 00000100:00100000:1.0:1788836495.618404:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836736 00000100:00100000:1.0:1788836495.618415:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836495.618428:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782836992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618456:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782836992:12345-0@lo:400:kworker.0 Request processed in 30us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618462:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836495.618473:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788836495.618478:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618505:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782837504:12345-0@lo:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618511:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788836495.618520:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788836495.618527:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782836608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618550:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782836608:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618555:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788836495.618565:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836495.618570:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782837120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618592:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782837120:12345-0@lo:400:kworker.0 Request processed in 23us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618597:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836495.618607:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788836495.618613:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782837632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618635:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782837632:12345-0@lo:400:kworker.0 Request processed in 23us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618639:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788836495.618649:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788836495.618661:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782836736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618689:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782836736:12345-0@lo:400:kworker.0 Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836495.618695:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788836495.618726:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836495.618730:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836495.618732:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836495.618762:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782836736:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618776:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155ea00 x1875730782837248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618787:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782837248:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618797:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a754380 x1875730782837760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618805:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782837760:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618815:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782836608:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618824:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155f800 x1875730782837120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618832:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782837120:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618842:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a754000 x1875730782837632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618850:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782837632:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618892:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782836480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618915:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782836992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836495.618925:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782837504:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618934:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155f480 x1875730782837376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618941:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782837376:0@lo:400:kworker.0 00010000:00080000:1.0:1788836495.618950:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a756300 x1875730782837888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836495.618958:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782837888:0@lo:400:kworker.0 00000100:00100000:3.0:1788836495.623110:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782836864 00000100:00100000:3.0:1788836495.623135:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782836864 00000100:00100000:3.0:1788836495.623194:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788836495.623215:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782836864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836495.623309:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782836864:12345-0@lo:400:kworker.0 Request processed in 107us (6017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836495.623317:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836495.623633:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782836864:0@lo:400:kworker.0 00000100:00100000:0.0:1788836495.623664:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836495.623673:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782838016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836495.623711:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836495.623742:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838016 00000100:00100000:0.0:1788836495.623746:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838016 00000100:00100000:0.0:1788836495.623774:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836495.623781:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782838016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836495.623797:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836495.623828:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782838016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836495.623834:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788836495.623943:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc26300 x1875730782838016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836495.623957:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782838016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836495.751757:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836496.129145:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782838144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836496.129217:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836496.129282:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838144 00000100:00100000:1.0:1788836496.129290:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838144 00000100:00100000:1.0:1788836496.129341:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836496.129351:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782838144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836496.129380:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836496.129421:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782838144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836496.129427:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788836496.129462:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d8000 x1875730782838144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836496.129479:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782838144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836496.769576:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836497.790215:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836498.174244:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836498.174269:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782838272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836498.174353:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836498.174429:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838272 00000100:00100000:0.0:1788836498.174436:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838272 00000100:00100000:0.0:1788836498.174492:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836498.174512:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782838272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836498.174547:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836498.174596:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782838272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.174603:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836498.174650:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782838272:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788836498.818914:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836499.198833:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836499.198932:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836499.204476:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838400 00000100:00100000:2.0:1788836499.204504:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838400 00000100:00100000:2.0:1788836499.204590:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836499.204605:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782838400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836499.204640:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788836499.204728:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836499.204731:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782838400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (5798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836499.204739:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788836499.205077:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f2a00 x1875730782838400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836499.205097:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836499.205119:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836499.205128:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782838528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836499.205169:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836499.205371:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838528 00000100:00100000:2.0:1788836499.205377:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838528 00000100:00100000:2.0:1788836499.205424:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836499.205433:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782838528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836499.205447:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836499.205493:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782838528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836499.205499:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788836499.205581:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc25f80 x1875730782838528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836499.205594:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782838528:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788836499.205701:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836499.401384:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836499.401492:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180096 00000100:00100000:1.0:1788836499.401503:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180096 00000100:00100000:1.0:1788836499.401584:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:1.0:1788836499.401595:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770180096:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.401679:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770180096:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 86us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.401687:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00080000:0.0:1788836499.402147:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836499.403087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836499.403137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836499.403237:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180352 00000100:00100000:1.0:1788836499.403246:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180352 00000100:00100000:1.0:1788836499.403299:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:1.0:1788836499.403309:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180352:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.403372:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180352:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.403379:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00080000:1.0:1788836499.403398:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836499.403524:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836499.403555:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836499.403578:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836499.403621:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836499.403663:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770179968 00000100:00100000:1.0:1788836499.403668:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770179968 00000100:00100000:1.0:1788836499.403696:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 305 00000100:00100000:1.0:1788836499.403704:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770179968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.403734:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770179968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.403740:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 305 00000100:00100000:1.0:1788836499.403841:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180224 00000100:00100000:1.0:1788836499.403845:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180224 00000100:00100000:1.0:1788836499.403871:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180480 00000100:00100000:1.0:1788836499.403880:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180480 00000100:00100000:1.0:1788836499.403904:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:1.0:1788836499.403911:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770180224:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.403943:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770180224:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.403949:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:1.0:1788836499.403978:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:1.0:1788836499.403985:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180480:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.404039:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180480:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.404047:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00080000:1.0:1788836499.404078:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836499.413166:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180608 00000100:00100000:0.0:1788836499.413184:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180608 00000100:00100000:1.0:1788836499.415051:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180736 00000100:00100000:1.0:1788836499.415074:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180736 00000100:00100000:1.0:1788836499.415168:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1788836499.415180:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.415260:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 82us (11637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.415268:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1788836499.415451:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:1.0:1788836499.415459:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836499.415498:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770180608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (12360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836499.415504:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00080000:2.0:1788836499.415597:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836499.415603:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836499.841903:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836500.224229:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782838656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836500.224301:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836500.224380:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838656 00000100:00100000:1.0:1788836500.224388:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838656 00000100:00100000:1.0:1788836500.224694:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788836500.224705:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782838656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836500.224741:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788836500.224802:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782838656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836500.224809:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836500.225480:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782838656:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788836500.226580:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:0.0:1788836500.227689:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:2.0:1788836500.230902:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:2.0:1788836500.231536:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:02000400:1.0:1788836500.267385:0:12173:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788836500.734800:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782839040:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.734884:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836500.734950:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782839552:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.734975:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836500.734991:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782840064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.735068:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836500.735100:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836500.735107:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782838912:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.735136:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836500.735158:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782839424:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.735179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836500.735180:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839040 00000100:00100000:0.0:1788836500.735188:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839040 00000100:00100000:2.0:1788836500.735194:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782839936:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.735211:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836500.735224:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839552 00000100:00100000:0.0:1788836500.735227:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839552 00000100:00100000:2.0:1788836500.735233:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840064 00000100:00100000:0.0:1788836500.735249:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839424 00000100:00100000:0.0:1788836500.735252:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839424 00000100:00100000:0.0:1788836500.735263:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839936 00000100:00100000:0.0:1788836500.735266:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839936 00000100:00100000:0.0:1788836500.735282:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836500.735291:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782839040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.735313:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782839168:0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.735337:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836500.735343:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782839040:12345-0@lo:400:kworker.0 Request processed in 54us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.735349:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782839680:0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.735350:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836500.735366:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839168 00000100:00100000:0.0:1788836500.735369:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839168 00000100:00100000:0.0:1788836500.735382:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788836500.735383:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.735398:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782840192:0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.735402:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782839552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.735417:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836500.735429:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782839552:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.735433:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788836500.735435:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788836500.735437:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782838784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836500.735446:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788836500.735451:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782839424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.735458:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836500.735597:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840064 00000100:00100000:2.0:1788836500.735621:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836500.735627:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836500.735695:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788836500.735704:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782839168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.739693:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782839296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.739765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.739792:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782839808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.739815:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.739858:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782840320:0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.739879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.739937:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838784 00000100:00100000:3.0:1788836500.739944:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838784 00000100:00100000:3.0:1788836500.739998:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836500.740007:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782838784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836500.740065:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836500.740110:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782838784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.740135:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836500.740158:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839296 00000100:00100000:3.0:1788836500.740161:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839296 00000100:00100000:3.0:1788836500.740189:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788836500.740195:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782839296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.740232:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782839296:12345-0@lo:400:kworker.0 Request processed in 37us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.740374:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1788836500.740417:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a7800 x1875730782838784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836500.740435:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782838784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836500.740445:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782839296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.740607:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1788836500.740617:0:6491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1788836500.740633:0:10681:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788836500.740639:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782839424:12345-0@lo:400:kworker.0 Request processed in 5187us (5458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.740640:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788836500.740646:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782840064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.740647:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788836500.740670:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839680 00000100:00100000:0.0:1788836500.740674:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839680 00000100:00100000:3.0:1788836500.740679:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782840064:12345-0@lo:400:kworker.0 Request processed in 34us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836500.740685:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788836500.740692:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840192 00000100:00100000:0.0:1788836500.740695:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840192 00000100:00100000:3.0:1788836500.740704:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782838912 00000100:00100000:3.0:1788836500.740708:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782838912 00000100:00100000:0.0:1788836500.740708:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782839808 00000100:00100000:0.0:1788836500.740710:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782839808 00000100:00100000:0.0:1788836500.740718:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840320 00000100:00100000:0.0:1788836500.740720:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840320 00000100:00100000:3.0:1788836500.740732:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788836500.740732:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836500.740738:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782838912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.740738:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782839680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836500.740768:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782838912:12345-0@lo:400:kworker.0 Request processed in 30us (5631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.740771:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782839680:12345-0@lo:400:kworker.0 Request processed in 34us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.740777:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836500.740779:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788836500.740787:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836500.740792:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782840192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.740819:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782840192:12345-0@lo:400:kworker.0 Request processed in 26us (5401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.740825:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836500.740844:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836500.740849:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.740879:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782839808:12345-0@lo:400:kworker.0 Request processed in 30us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.740884:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836500.740894:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836500.740899:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836500.740923:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782840320:12345-0@lo:400:kworker.0 Request processed in 24us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.740929:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788836500.741058:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43861f80 x1875730782839808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836500.741070:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782839808:0@lo:400:kworker.0 00010000:00080000:0.0:1788836500.741081:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817b8380 x1875730782840320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836500.741098:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782840320:0@lo:400:kworker.0 00010000:00080000:0.0:1788836500.741108:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43861880 x1875730782839680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836500.741116:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782839680:0@lo:400:kworker.0 00010000:00080000:0.0:1788836500.741125:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817b9f80 x1875730782840192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836500.741133:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782840192:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.748266:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782839936:12345-0@lo:400:kworker.0 Request processed in 12628us (13043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836500.748281:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788836500.748341:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836500.748348:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836500.748351:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836500.748386:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782838912:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.748402:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782839424:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.748411:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782839936:0@lo:400:kworker.0 00000100:00100000:2.0:1788836500.748423:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782839040:0@lo:400:kworker.0 00010000:00080000:2.0:1788836500.748438:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43862a00 x1875730782839552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836500.748449:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782839552:0@lo:400:kworker.0 00010000:00080000:2.0:1788836500.748459:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43860380 x1875730782840064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836500.748468:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782840064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836500.762029:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782839168:12345-0@lo:400:kworker.0 Request processed in 26299us (26663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836500.762057:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788836500.762660:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782839168:0@lo:400:kworker.0 00010000:00010000:0.0:1788836500.862206:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836501.246506:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836501.246532:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782840448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836501.246600:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836501.246730:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840448 00000100:00100000:2.0:1788836501.246737:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840448 00000100:00100000:2.0:1788836501.246792:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836501.246801:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782840448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836501.246824:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836501.246879:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782840448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836501.246887:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788836501.246981:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817b9f80 x1875730782840448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836501.247003:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782840448:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836501.889870:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836502.911825:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836503.294227:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782840576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836503.294318:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836503.294479:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840576 00000100:00100000:0.0:1788836503.294488:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840576 00000100:00100000:0.0:1788836503.294539:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788836503.294548:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782840576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836503.294587:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836503.294631:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782840576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836503.294638:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788836503.294880:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782840576:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788836503.934248:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836504.318734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782840704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836504.318811:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836504.318928:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840704 00000100:00100000:2.0:1788836504.318937:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840704 00000100:00100000:2.0:1788836504.319042:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836504.319067:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782840704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836504.319095:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836504.320211:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782840832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836504.320267:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836504.320345:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840832 00000100:00100000:0.0:1788836504.320363:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840832 00000100:00100000:0.0:1788836504.320411:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836504.320421:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782840832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836504.320439:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836504.320478:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782840832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836504.320485:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788836504.320507:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836504.320537:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5500 x1875730782840832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836504.320556:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782840832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836504.321707:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782840704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2637us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836504.321717:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788836504.322269:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a5500 x1875730782840704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836504.322294:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782840704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836504.512087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512120:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512151:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512207:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836504.512211:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181504 00000100:00100000:1.0:1788836504.512221:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181504 00000100:00100000:2.0:1788836504.512223:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836504.512263:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180992 00000100:00100000:2.0:1788836504.512266:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180992 00000100:00100000:1.0:1788836504.512286:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181632 00000100:00100000:1.0:1788836504.512289:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181632 00000100:00100000:2.0:1788836504.512293:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181248 00000100:00100000:2.0:1788836504.512295:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181248 00000100:00100000:2.0:1788836504.512309:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181120 00000100:00100000:1.0:1788836504.512310:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1788836504.512312:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181120 00000100:00100000:1.0:1788836504.512319:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181504:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836504.512321:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181376 00000100:00100000:2.0:1788836504.512323:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181376 00000100:00100000:2.0:1788836504.512335:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788836504.512340:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770180992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836504.512430:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:3.0:1788836504.512439:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836504.512497:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770180992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 156us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836504.512505:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788836504.512522:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:2.0:1788836504.512528:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770181120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836504.513497:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:0.0:1788836504.513514:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836504.518955:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181504:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 6622us (6788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836504.518998:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:1.0:1788836504.519061:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788836504.519074:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181632:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836504.519124:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181632:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 56us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836504.519130:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788836504.519157:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770180864 00000100:00100000:1.0:1788836504.519165:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770180864 00000100:00100000:1.0:1788836504.519204:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 307 00000100:00100000:1.0:1788836504.519210:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770180864:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836504.519252:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770180864:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (7063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836504.519259:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 307 00000100:00080000:1.0:1788836504.522142:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836504.522152:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836504.522155:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836504.522159:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836504.523633:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 11179us (11496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836504.523651:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:2.0:1788836504.527632:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770181120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 15090us (15408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836504.527647:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:0.0:1788836504.528157:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770181376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 14646us (15928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836504.528168:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 151 00010000:00010000:2.0:1788836504.973091:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836505.343228:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782840960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836505.343316:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836505.344717:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782840960 00000100:00100000:0.0:1788836505.344731:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782840960 00000100:00100000:0.0:1788836505.344795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788836505.344805:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782840960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836505.344846:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788836505.344920:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782840960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836505.344927:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788836505.345262:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782840960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836505.854249:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782841088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836505.854332:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836505.854552:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841088 00000100:00100000:2.0:1788836505.854561:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841088 00000100:00100000:2.0:1788836505.854632:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836505.854643:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782841088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836505.854672:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788836505.854733:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836505.855696:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782841088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1050us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836505.855708:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836505.856102:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782841344:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856149:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856183:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782841856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856206:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856223:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782842368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856241:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856264:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836505.856270:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782841216:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782841728:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856334:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856350:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782842240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856370:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856412:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841344 00000100:00100000:1.0:1788836505.856424:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841344 00000100:00100000:1.0:1788836505.856463:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841856 00000100:00100000:1.0:1788836505.856466:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841856 00000100:00100000:1.0:1788836505.856486:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842368 00000100:00100000:1.0:1788836505.856488:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842368 00000100:00100000:1.0:1788836505.856500:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841728 00000100:00100000:1.0:1788836505.856502:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841728 00000100:00100000:1.0:1788836505.856512:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842240 00000100:00100000:1.0:1788836505.856514:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842240 00000100:00100000:1.0:1788836505.856529:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788836505.856536:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856581:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782841344:12345-0@lo:400:kworker.0 Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856588:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788836505.856608:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788836505.856614:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782841856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856639:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782841856:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856644:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788836505.856656:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788836505.856662:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782842368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856687:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782842368:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856691:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788836505.856711:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788836505.856717:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782841728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856744:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782841728:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856759:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788836505.856771:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836505.856776:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856804:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782842240:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856809:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836505.856830:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841216 00000100:00100000:1.0:1788836505.856834:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841216 00000100:00100000:1.0:1788836505.856855:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788836505.856862:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856890:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782841216:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.856897:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1788836505.856922:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836505.856926:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836505.856938:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782841472:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.856974:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.856992:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782841984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.857052:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782842496:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857072:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.857090:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836505.857097:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782841600:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857119:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.857136:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782842112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857165:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836505.857191:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841984 00000100:00100000:1.0:1788836505.857195:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841984 00000100:00100000:1.0:1788836505.857218:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842496 00000100:00100000:1.0:1788836505.857221:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842496 00000100:00100000:1.0:1788836505.857239:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842112 00000100:00100000:1.0:1788836505.857242:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842112 00000100:00100000:1.0:1788836505.857253:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836505.857258:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782841984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857292:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782841984:12345-0@lo:400:kworker.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.857299:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836505.857309:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836505.857315:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782842496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857342:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782842496:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.857347:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836505.857357:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836505.857363:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857387:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782842112:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.857392:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836505.857412:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841600 00000100:00100000:1.0:1788836505.857416:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841600 00000100:00100000:1.0:1788836505.857440:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836505.857447:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782841600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857478:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782841600:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.857490:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788836505.857513:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836505.857537:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782841216:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857549:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782841728:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857559:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782842240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782841344:0@lo:400:kworker.0 00010000:00080000:1.0:1788836505.857581:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444f8700 x1875730782841856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836505.857592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782841856:0@lo:400:kworker.0 00010000:00080000:1.0:1788836505.857601:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a754700 x1875730782842368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836505.857610:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782842368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857650:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782841472 00000100:00100000:1.0:1788836505.857654:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782841472 00000100:00100000:1.0:1788836505.857675:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836505.857681:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782841472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857710:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782841472:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836505.857715:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836505.857740:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782841600:0@lo:400:kworker.0 00010000:00080000:1.0:1788836505.857750:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a754e00 x1875730782842112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836505.857772:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782842112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836505.857784:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782841472:0@lo:400:kworker.0 00010000:00080000:1.0:1788836505.857794:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444fad80 x1875730782841984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836505.857801:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782841984:0@lo:400:kworker.0 00010000:00080000:1.0:1788836505.857811:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a756300 x1875730782842496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836505.857818:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782842496:0@lo:400:kworker.0 00010000:00080000:3.0:1788836505.859253:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a4700 x1875730782841088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836505.859277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782841088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836505.982192:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836506.366252:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782842624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836506.366324:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836506.366440:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842624 00000100:00100000:1.0:1788836506.366450:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842624 00000100:00100000:1.0:1788836506.366497:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836506.366507:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782842624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836506.366539:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836506.375363:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782842624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8847us (9029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836506.375379:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788836506.379184:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155fb80 x1875730782842624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836506.379212:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782842624:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788836507.006526:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836507.671883:0:12489:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836507.674946:0:12489:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836508.030196:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836508.414383:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782842752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836508.414453:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836508.414574:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842752 00000100:00100000:1.0:1788836508.414583:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842752 00000100:00100000:1.0:1788836508.414635:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788836508.414644:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782842752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836508.414677:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836508.414733:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782842752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836508.414749:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788836508.415366:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782842752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788836509.055471:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836509.438214:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782842880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836509.438289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836509.438466:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782842880 00000100:00100000:2.0:1788836509.438474:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782842880 00000100:00100000:2.0:1788836509.438764:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788836509.438775:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782842880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836509.438806:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836509.438866:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782842880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836509.438874:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788836509.438904:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836509.439272:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836509.439284:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782843008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836509.439319:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836509.439470:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843008 00000100:00100000:1.0:1788836509.439475:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843008 00000100:00100000:1.0:1788836509.439513:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836509.439520:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782843008:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788836509.441970:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836509.442318:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a6a00 x1875730782842880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.442355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782842880:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836509.442453:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836509.442534:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782843008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3014us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836509.442543:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788836509.442809:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155c000 x1875730782843008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.442831:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782843008:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788836509.573687:0:12587:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836509.573945:0:12587:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788836509.646538:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646616:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646652:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646677:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646698:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646717:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836509.646743:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836509.647076:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181760 00000100:00100000:3.0:1788836509.647086:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181760 00000100:00100000:3.0:1788836509.647141:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 309 00000100:00100000:3.0:1788836509.647152:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770181760:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836509.647226:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770181760:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 76us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836509.647234:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 309 00000100:00100000:0.0:1788836509.648401:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182016 00000100:00100000:0.0:1788836509.648410:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182016 00000100:00080000:2.0:1788836509.651104:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836509.653249:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182272 00000100:00100000:1.0:1788836509.653264:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182272 00000100:00080000:2.0:1788836509.653479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836509.656569:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182528 00000100:00100000:3.0:1788836509.656583:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182528 00000100:00100000:3.0:1788836509.656641:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182400 00000100:00100000:3.0:1788836509.656644:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182400 00000100:00100000:3.0:1788836509.656670:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1788836509.656680:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182528:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836509.657165:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182528:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 485us (10485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836509.657174:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1788836509.657194:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788836509.657200:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836509.657227:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836509.657233:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788836509.657251:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770181888 00000100:00100000:3.0:1788836509.657255:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770181888 00000100:00080000:2.0:1788836509.657519:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836509.657525:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836509.657527:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836509.665669:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182144 00000100:00100000:0.0:1788836509.665687:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182144 00000100:00100000:1.0:1788836509.665801:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1788836509.665815:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770182016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836509.665909:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770182016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 98us (19292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836509.665971:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:3.0:1788836509.665983:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836509.666035:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 55us (19381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836509.669555:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1788836509.669618:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:1.0:1788836509.669639:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770181888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836509.669727:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770181888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 100us (23028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836509.669735:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:0.0:1788836509.671139:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00100000:0.0:1788836509.671157:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836509.671223:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770182144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 74us (24504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836509.671231:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00080000:2.0:1788836509.679933:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836509.683899:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00010000:00010000:0.0:1788836510.078296:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836510.465450:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836510.465479:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782843136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836510.465580:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836510.465651:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843136 00000100:00100000:2.0:1788836510.465660:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843136 00000100:00100000:2.0:1788836510.465713:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788836510.465722:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782843136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836510.465756:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836510.465802:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782843136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836510.465809:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788836510.465855:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782843136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836510.974522:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782843392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974658:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.974727:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782843904:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.974768:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782844416:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974787:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.974819:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836510.974826:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782843264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974874:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.974898:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782843776:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974946:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.974974:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782844288:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.974994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975046:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782843648:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975070:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975086:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782844160:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975104:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975117:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782844672:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975135:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975152:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788836510.975156:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782843520:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975174:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975189:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782844032:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975223:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782844544:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.975252:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836510.975280:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843392 00000100:00100000:1.0:1788836510.976479:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843392 00000100:00100000:1.0:1788836510.976532:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843904 00000100:00100000:1.0:1788836510.976535:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843904 00000100:00100000:1.0:1788836510.976558:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844416 00000100:00100000:1.0:1788836510.976560:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844416 00000100:00100000:1.0:1788836510.976570:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843776 00000100:00100000:1.0:1788836510.976572:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843776 00000100:00100000:1.0:1788836510.976582:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844288 00000100:00100000:1.0:1788836510.976584:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844288 00000100:00100000:1.0:1788836510.976594:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843520 00000100:00100000:1.0:1788836510.976596:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843520 00000100:00100000:1.0:1788836510.976610:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788836510.976619:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782843392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976691:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782843392:12345-0@lo:400:kworker.0 Request processed in 72us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976698:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788836510.976715:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788836510.976721:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782843904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976746:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782843904:12345-0@lo:400:kworker.0 Request processed in 26us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976751:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788836510.976762:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788836510.976767:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782844416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976789:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782844416:12345-0@lo:400:kworker.0 Request processed in 23us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976794:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788836510.976817:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788836510.976822:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782843776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976849:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782843776:12345-0@lo:400:kworker.0 Request processed in 27us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976855:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788836510.976879:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836510.976886:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782844288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976913:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782844288:12345-0@lo:400:kworker.0 Request processed in 28us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976918:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836510.976929:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788836510.976934:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782843520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.976976:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782843520:12345-0@lo:400:kworker.0 Request processed in 41us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.976981:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788836510.977004:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843264 00000100:00100000:1.0:1788836510.977007:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843264 00000100:00100000:1.0:1788836510.977052:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788836510.977058:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782843264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977087:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782843264:12345-0@lo:400:kworker.0 Request processed in 29us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977093:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788836510.977137:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782843648 00000100:00100000:1.0:1788836510.977141:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782843648 00000100:00100000:1.0:1788836510.977162:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788836510.977168:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782843648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977205:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782843648:12345-0@lo:400:kworker.0 Request processed in 37us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977212:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788836510.977229:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844160 00000100:00100000:1.0:1788836510.977232:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844160 00000100:00100000:1.0:1788836510.977280:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844672 00000100:00100000:1.0:1788836510.977282:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844672 00000100:00100000:1.0:1788836510.977305:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844032 00000100:00100000:1.0:1788836510.977308:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844032 00000100:00100000:1.0:1788836510.977317:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844544 00000100:00100000:1.0:1788836510.977320:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844544 00000100:00100000:1.0:1788836510.977332:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836510.977337:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782844160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977365:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782844160:12345-0@lo:400:kworker.0 Request processed in 28us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977371:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836510.977381:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836510.977387:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977429:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782844672:12345-0@lo:400:kworker.0 Request processed in 42us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977434:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836510.977445:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836510.977451:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782844032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977474:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782844032:12345-0@lo:400:kworker.0 Request processed in 24us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977479:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836510.977488:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836510.977499:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782844544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977525:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782844544:12345-0@lo:400:kworker.0 Request processed in 26us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836510.977530:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836510.977589:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782843520:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.977605:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6d80 x1875730782844032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.977616:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782844032:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.977626:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43863b80 x1875730782844544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.977635:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782844544:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.977645:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782843648:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.977655:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c4a80 x1875730782844160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.977663:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782844160:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.977673:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43860380 x1875730782844672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.977681:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782844672:0@lo:400:kworker.0 00000100:00080000:2.0:1788836510.978389:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836510.978397:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836510.978399:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836510.983763:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782843264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.983789:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782843776:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.983801:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782844288:0@lo:400:kworker.0 00000100:00100000:1.0:1788836510.983833:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782843392:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.983848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c6300 x1875730782843904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.983858:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782843904:0@lo:400:kworker.0 00010000:00080000:1.0:1788836510.983881:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43861180 x1875730782844416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836510.983890:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782844416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836510.984380:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782844800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836510.984501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836510.984571:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844800 00000100:00100000:0.0:1788836510.984578:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844800 00000100:00100000:0.0:1788836510.984621:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836510.984630:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782844800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836510.984671:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836510.993470:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782844800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8829us (8957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836510.993487:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788836511.003417:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444fbb80 x1875730782844800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836511.003467:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782844800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836511.105129:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836511.486206:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836511.486231:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782844928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836511.486300:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836511.486357:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782844928 00000100:00100000:0.0:1788836511.486367:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782844928 00000100:00100000:0.0:1788836511.486426:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788836511.486437:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782844928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836511.486463:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836511.486526:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782844928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836511.486534:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788836511.488357:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444f8700 x1875730782844928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836511.488382:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782844928:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788836511.895265:0:12685:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836511.895539:0:12685:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836512.126255:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836513.150305:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836513.534420:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836513.534490:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836513.534619:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845056 00000100:00100000:1.0:1788836513.534627:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845056 00000100:00100000:1.0:1788836513.535607:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788836513.535620:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836513.535655:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836513.535769:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836513.535776:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836513.536506:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845056:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788836514.088520:0:12782:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836514.092115:0:12782:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788836514.174558:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836514.558457:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836514.558483:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836514.558576:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836514.558769:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782845312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836514.559187:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845184 00000100:00100000:0.0:1788836514.559197:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845184 00000100:00100000:0.0:1788836514.559370:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788836514.559382:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836514.559411:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788836514.559451:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836514.559527:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836514.559629:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845312 00000100:00100000:1.0:1788836514.559633:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845312 00000100:00100000:1.0:1788836514.559658:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788836514.559664:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782845312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836514.559675:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788836514.559712:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836514.559725:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782845312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.559733:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788836514.559978:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a5500 x1875730782845312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836514.559998:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782845312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836514.560102:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 723us (1525us total) trans 0 rc 0/0 00010000:00080000:3.0:1788836514.560103:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428d8700 x1875730782845184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836514.560110:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836514.560116:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836514.755378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759207:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759249:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759267:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759295:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759329:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759413:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836514.759445:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182784 00000100:00100000:1.0:1788836514.759455:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182784 00000100:00100000:1.0:1788836514.759512:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183040 00000100:00100000:1.0:1788836514.759515:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183040 00000100:00100000:1.0:1788836514.759535:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182912 00000100:00100000:1.0:1788836514.759538:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182912 00000100:00100000:1.0:1788836514.759550:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183168 00000100:00100000:1.0:1788836514.759552:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183168 00000100:00100000:1.0:1788836514.759569:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:1.0:1788836514.759579:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770182784:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836514.759657:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770182784:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 79us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.759677:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:1.0:1788836514.759694:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:1.0:1788836514.759700:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770183040:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836514.759726:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770183040:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.759732:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:1.0:1788836514.759745:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:1.0:1788836514.759750:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770182912:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836514.759773:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770182912:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.759779:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:1.0:1788836514.759789:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:1.0:1788836514.759808:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770183168:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836514.759830:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770183168:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.759836:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:1.0:1788836514.759864:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183296 00000100:00100000:1.0:1788836514.759867:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183296 00000100:00100000:1.0:1788836514.759891:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183424 00000100:00100000:1.0:1788836514.759894:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183424 00000100:00100000:1.0:1788836514.759915:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:1.0:1788836514.759920:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2393:x1875730770183296:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788836514.759940:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65540c1 00000100:00080000:1.0:1788836514.759948:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836514.759999:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788836514.760152:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+2:2393:x1875730770183296:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 231us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.760161:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:1.0:1788836514.760173:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788836514.760179:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2393:x1875730770183424:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788836514.760191:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65540c8 00000100:00080000:1.0:1788836514.760197:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc16000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836514.760220:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788836514.760287:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af47d36a-929f-4c54-b0ec-8b3068716457+2:2393:x1875730770183424:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 107us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836514.760294:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00080000:1.0:1788836514.760317:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836514.760321:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836514.760324:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836514.760326:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836514.760472:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836514.760478:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836514.766264:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770182656 00000100:00100000:2.0:1788836514.766280:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770182656 00000100:00100000:3.0:1788836514.766464:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 311 00000100:00100000:3.0:1788836514.766475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770182656:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836514.766556:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770182656:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 82us (11186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836514.766564:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 311 00010000:00010000:1.0:1788836515.201997:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836515.590899:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782845440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836515.590972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836515.591067:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845440 00000100:00100000:3.0:1788836515.591074:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845440 00000100:00100000:3.0:1788836515.591118:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836515.591125:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782845440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836515.591179:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836515.591226:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782845440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836515.591234:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836515.591621:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782845440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836516.095832:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836516.095941:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.096074:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845568 00000100:00100000:3.0:1788836516.096085:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845568 00000100:00100000:3.0:1788836516.096158:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836516.096169:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836516.096210:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836516.096262:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782845568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.096270:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788836516.096296:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788836516.096334:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43862300 x1875730782845568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836516.096356:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836516.097300:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782845824:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097351:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097406:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782846336:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097430:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097455:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782846848:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097532:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836516.097538:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782845952:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097586:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782846464:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782846976:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.097643:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.097693:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845824 00000100:00100000:3.0:1788836516.097699:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845824 00000100:00100000:3.0:1788836516.097744:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846336 00000100:00100000:3.0:1788836516.097747:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846336 00000100:00100000:3.0:1788836516.097767:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846848 00000100:00100000:3.0:1788836516.097770:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846848 00000100:00100000:2.0:1788836516.098413:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846464 00000100:00100000:2.0:1788836516.098423:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846464 00000100:00100000:2.0:1788836516.098455:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846976 00000100:00100000:2.0:1788836516.098459:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846976 00000100:00100000:2.0:1788836516.098478:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836516.098487:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782845824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098587:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782845824:12345-0@lo:400:kworker.0 Request processed in 100us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836516.098595:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836516.098614:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788836516.098621:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782846336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098649:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782846336:12345-0@lo:400:kworker.0 Request processed in 29us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836516.098656:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788836516.098667:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788836516.098673:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782846464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098701:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782846464:12345-0@lo:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836516.098706:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788836516.098721:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788836516.098726:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782846976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098753:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782846976:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836516.098759:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:2.0:1788836516.098837:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43899880 x1875730782846464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836516.098854:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782846464:0@lo:400:kworker.0 00010000:00080000:2.0:1788836516.098867:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f0e00 x1875730782846976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836516.098876:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782846976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098899:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782845824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.098911:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782846336:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099074:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788836516.099084:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099127:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782846848:12345-0@lo:400:kworker.0 Request processed in 45us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.099133:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788836516.099163:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845952 00000100:00100000:3.0:1788836516.099167:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845952 00000100:00100000:3.0:1788836516.099195:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836516.099202:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782845952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099241:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782845952:12345-0@lo:400:kworker.0 Request processed in 40us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.099248:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836516.099292:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782845696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099343:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099381:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782846208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099407:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099426:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782846720:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099449:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099476:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788836516.099483:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782846080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099507:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099527:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782846592:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099546:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099565:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782847104:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099587:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836516.099619:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782845696 00000100:00100000:3.0:1788836516.099623:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782845696 00000100:00100000:3.0:1788836516.099651:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788836516.099658:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782845696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.099695:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782845696:12345-0@lo:400:kworker.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.099702:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788836516.099731:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846208 00000100:00100000:3.0:1788836516.099735:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846208 00000100:00100000:3.0:1788836516.099757:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836516.099764:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782846208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.101670:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782846208:12345-0@lo:400:kworker.0 Request processed in 1888us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.101712:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836516.101770:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846720 00000100:00100000:2.0:1788836516.102976:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846080 00000100:00100000:2.0:1788836516.102991:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846080 00000100:00100000:2.0:1788836516.103083:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788836516.103095:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782846080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.103197:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782846080:12345-0@lo:400:kworker.0 Request processed in 103us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836516.103204:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788836516.103276:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782845952:0@lo:400:kworker.0 00000100:00100000:2.0:1788836516.103293:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782846848:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.103391:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846720 00000100:00100000:3.0:1788836516.103447:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782846592 00000100:00100000:3.0:1788836516.103451:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782846592 00000100:00100000:3.0:1788836516.103467:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847104 00000100:00100000:3.0:1788836516.103470:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847104 00000100:00100000:3.0:1788836516.103487:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836516.103495:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.103554:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782846720:12345-0@lo:400:kworker.0 Request processed in 60us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.103561:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836516.103573:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836516.103579:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.103606:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782846592:12345-0@lo:400:kworker.0 Request processed in 28us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.103612:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836516.103623:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788836516.103629:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782847104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.103657:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782847104:12345-0@lo:400:kworker.0 Request processed in 29us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836516.103663:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788836516.103703:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836516.103708:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836516.103711:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836516.103715:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836516.103762:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782846080:0@lo:400:kworker.0 00010000:00080000:3.0:1788836516.104748:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817bbb80 x1875730782846592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836516.104762:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782846592:0@lo:400:kworker.0 00010000:00080000:3.0:1788836516.104785:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f1880 x1875730782847104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836516.104795:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782847104:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.104809:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782845696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836516.104822:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782846208:0@lo:400:kworker.0 00010000:00080000:3.0:1788836516.104836:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf817b8700 x1875730782846720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836516.104843:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782846720:0@lo:400:kworker.0 00000020:00000004:1.0:1788836516.129635:0:12880:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836516.133814:0:12880:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836516.253043:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836516.607262:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782847232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836516.607373:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836516.607542:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847232 00000100:00100000:1.0:1788836516.607557:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847232 00000100:00100000:1.0:1788836516.607639:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788836516.607651:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782847232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836516.607685:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836516.607744:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782847232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836516.607783:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1788836516.608072:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c4380 x1875730782847232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836516.608096:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782847232:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836517.246863:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836518.271202:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836518.655822:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782847360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836518.655917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836518.656174:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847360 00000100:00100000:0.0:1788836518.656185:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847360 00000100:00100000:0.0:1788836518.656280:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788836518.656291:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782847360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836518.656339:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836518.656416:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782847360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836518.656431:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836518.656517:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782847360:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788836519.295256:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836519.678220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782847488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836519.678289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836519.678476:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847488 00000100:00100000:2.0:1788836519.678484:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847488 00000100:00100000:2.0:1788836519.678553:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836519.678563:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782847488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836519.678593:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836519.678654:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782847488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836519.678661:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788836519.678702:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f1880 x1875730782847488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836519.678743:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782847488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836519.678847:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836519.679860:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782847616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836519.679911:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836519.680007:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847616 00000100:00100000:0.0:1788836519.680037:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847616 00000100:00100000:0.0:1788836519.680080:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836519.680088:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782847616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836519.680105:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836519.680140:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782847616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836519.680146:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788836519.680205:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836519.680231:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a7480 x1875730782847616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836519.680245:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782847616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836519.903350:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836519.903392:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183680 00000100:00100000:1.0:1788836519.903402:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183680 00000100:00100000:1.0:1788836519.903467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00100000:1.0:1788836519.903478:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770183680:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836519.903552:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770183680:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836519.903561:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00080000:1.0:1788836519.903583:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836519.903627:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836519.904001:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836519.904053:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836519.904080:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836519.904102:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183936 00000100:00100000:1.0:1788836519.904107:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183936 00000100:00100000:1.0:1788836519.904137:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183808 00000100:00100000:1.0:1788836519.904140:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183808 00000100:00100000:1.0:1788836519.904155:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184064 00000100:00100000:1.0:1788836519.904158:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184064 00000100:00100000:1.0:1788836519.904172:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:1.0:1788836519.904178:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770183936:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836519.904215:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770183936:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836519.904233:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:1.0:1788836519.904246:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:1.0:1788836519.904252:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770183808:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836519.904277:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770183808:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836519.904282:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:1.0:1788836519.904293:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:1.0:1788836519.904299:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770184064:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836519.904322:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770184064:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836519.904328:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00080000:1.0:1788836519.904349:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836519.904352:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836519.904724:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770183552 00000100:00100000:3.0:1788836519.904729:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770183552 00000100:00100000:3.0:1788836519.904766:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 313 00000100:00100000:3.0:1788836519.904774:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770183552:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836519.904806:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770183552:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836519.904813:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 313 00000001:00100000:3.0:1788836520.209649:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000020:00000080:3.0:1788836520.209662:0:8401:0:(genops.c:885:class_export_put()) final put ffff8adf7fc1d800/af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:0.0:1788836520.210119:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000020:00000080:2.0:1788836520.210125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fc1d800/af47d36a-929f-4c54-b0ec-8b3068716457 for lustre-OST0000 00000020:00000080:0.0:1788836520.210136:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf7fc16800/af47d36a-929f-4c54-b0ec-8b3068716457 00000020:00000080:2.0:1788836520.212812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fc16800/af47d36a-929f-4c54-b0ec-8b3068716457 for lustre-OST0001 00000020:00000080:2.0:1788836520.212844:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7fc1b000 for lustre-OST0000 00000020:00000080:2.0:1788836520.212849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7fc16000 for lustre-OST0001 00000001:02000400:1.0:1788836520.215545:0:13024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788836520.319050:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836520.702293:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836520.702318:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782847744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836520.702394:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836520.702515:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847744 00000100:00100000:3.0:1788836520.702525:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847744 00000100:00100000:3.0:1788836520.702582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788836520.702591:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782847744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836520.702637:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836520.702689:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782847744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.702726:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788836520.703071:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782847744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836521.214388:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782847872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836521.214466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836521.214754:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782847872 00000100:00100000:1.0:1788836521.214764:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782847872 00000100:00100000:1.0:1788836521.214831:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836521.214843:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782847872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836521.214876:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836521.214920:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782847872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.214927:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788836521.215028:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788836521.217204:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fea00 x1875730782847872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836521.217233:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782847872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836521.220861:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782848256:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.220935:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836521.220981:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782848768:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.221007:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836521.221063:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782849280:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.221085:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836521.221228:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848768 00000100:00100000:1.0:1788836521.221239:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848768 00000100:00100000:1.0:1788836521.221310:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849280 00000100:00100000:1.0:1788836521.221320:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849280 00000100:00100000:1.0:1788836521.221346:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788836521.221355:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782848768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.221406:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782848768:12345-0@lo:400:kworker.0 Request processed in 52us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.221414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788836521.221432:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788836521.221438:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782849280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.221464:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782849280:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.221470:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1788836521.221510:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836521.221612:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788836521.221623:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782848128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.221650:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836521.221679:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782848640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.221712:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836521.221732:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782849152:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.221749:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788836521.221783:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fca80 x1875730782848768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836521.221798:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782848768:0@lo:400:kworker.0 00010000:00080000:3.0:1788836521.221809:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9a680 x1875730782849280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836521.221818:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782849280:0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.221892:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848128 00000100:00100000:1.0:1788836521.221896:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848128 00000100:00100000:1.0:1788836521.221927:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848640 00000100:00100000:1.0:1788836521.221930:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848640 00000100:00100000:1.0:1788836521.221950:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849152 00000100:00100000:1.0:1788836521.221952:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849152 00000100:00100000:1.0:1788836521.221969:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788836521.221975:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782848128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.222044:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782848128:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.222051:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788836521.222063:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788836521.222070:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782848640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.222098:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782848640:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.222114:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788836521.222138:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788836521.222145:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782849152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836521.222173:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782849152:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836521.222179:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1788836521.222199:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836521.222391:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782848128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.222403:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782848640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.222412:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782849152:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223071:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782848000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223126:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223163:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782848512:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223189:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782849024:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223229:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223251:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788836521.223257:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782848384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223422:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782848896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223440:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223451:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782849408:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223467:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836521.223502:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848384 00000100:00100000:2.0:1788836521.223507:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848384 00000100:00100000:2.0:1788836521.223535:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788836521.223541:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782848384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.223579:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782848384:12345-0@lo:400:kworker.0 Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836521.223585:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788836521.223627:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782848384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836521.223738:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848256 00000100:00100000:0.0:1788836521.223743:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848256 00000100:00100000:0.0:1788836521.223774:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848512 00000100:00100000:0.0:1788836521.223777:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848512 00000100:00100000:0.0:1788836521.223791:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788836521.223797:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782848256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836521.223836:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782848256:12345-0@lo:400:kworker.0 Request processed in 39us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836521.223842:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788836521.223862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788836521.223867:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782848512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836521.223893:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782848512:12345-0@lo:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836521.223899:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788836521.224353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782848512:0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.225247:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848000 00000100:00100000:3.0:1788836521.225254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848000 00000100:00100000:3.0:1788836521.225313:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788836521.225321:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782848000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.225391:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782848000:12345-0@lo:400:kworker.0 Request processed in 70us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.225408:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788836521.225443:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849024 00000100:00100000:3.0:1788836521.225447:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849024 00000100:00100000:3.0:1788836521.225486:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782848896 00000100:00100000:3.0:1788836521.225489:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782848896 00000100:00100000:3.0:1788836521.225500:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849408 00000100:00100000:3.0:1788836521.225502:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849408 00000100:00100000:3.0:1788836521.225515:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788836521.225521:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782849024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.225554:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782849024:12345-0@lo:400:kworker.0 Request processed in 33us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.225560:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788836521.225570:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788836521.225576:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782848896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.225602:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782848896:12345-0@lo:400:kworker.0 Request processed in 27us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.225608:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788836521.225618:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788836521.225624:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782849408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836521.225653:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782849408:12345-0@lo:400:kworker.0 Request processed in 29us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.225659:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788836521.225730:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782848256:0@lo:400:kworker.0 00000100:00080000:0.0:1788836521.227658:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836521.227668:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836521.229321:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fc000 x1875730782848896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836521.229341:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782848896:0@lo:400:kworker.0 00010000:00080000:2.0:1788836521.229356:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc99880 x1875730782849408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836521.229365:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782849408:0@lo:400:kworker.0 00000100:00100000:2.0:1788836521.229377:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782848000:0@lo:400:kworker.0 00010000:00080000:2.0:1788836521.229388:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fea00 x1875730782849024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836521.229396:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782849024:0@lo:400:kworker.0 00010000:00010000:1.0:1788836521.342361:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836521.726412:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782849536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836521.726490:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836521.726736:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849536 00000100:00100000:3.0:1788836521.726745:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849536 00000100:00100000:3.0:1788836521.726875:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788836521.726902:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782849536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836521.726942:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836521.727003:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782849536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.727031:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788836521.727275:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c7100 x1875730782849536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836521.727308:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782849536:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836522.366285:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836523.391821:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836523.774230:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782849664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836523.774298:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836523.774451:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849664 00000100:00100000:0.0:1788836523.774459:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849664 00000100:00100000:0.0:1788836523.774726:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836523.774737:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782849664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836523.774783:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836523.774836:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782849664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836523.774903:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782849664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836523.779278:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:1.0:1788836524.414311:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836524.798772:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782849792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836524.798885:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836524.799173:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849792 00000100:00100000:0.0:1788836524.799185:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849792 00000100:00100000:0.0:1788836524.799266:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836524.799277:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782849792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836524.799317:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836524.799372:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782849792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836524.799380:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788836524.799434:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a7480 x1875730782849792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836524.799455:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782849792:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836524.801210:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836524.802862:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836524.802899:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782849920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836524.803005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836524.803264:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782849920 00000100:00100000:0.0:1788836524.803294:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782849920 00000100:00100000:0.0:1788836524.803382:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788836524.803394:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782849920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836524.803427:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836524.803487:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782849920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836524.803495:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788836524.803546:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a7480 x1875730782849920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836524.803569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782849920:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788836524.804779:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836524.996158:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836524.996209:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836524.996242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836524.996266:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836524.996294:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836524.996331:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184320 00000100:00100000:2.0:1788836524.996344:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184320 00000100:00100000:2.0:1788836524.996412:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184576 00000100:00100000:2.0:1788836524.996415:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184576 00000100:00100000:2.0:1788836524.996435:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184448 00000100:00100000:2.0:1788836524.996437:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184448 00000100:00100000:2.0:1788836524.996450:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184704 00000100:00100000:2.0:1788836524.996452:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184704 00000100:00100000:2.0:1788836524.996471:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:2.0:1788836524.996482:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770184320:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836524.996579:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770184320:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836524.996587:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:2.0:1788836524.996628:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:2.0:1788836524.996636:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770184576:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836524.996662:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770184576:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836524.996668:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:2.0:1788836524.996680:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:2.0:1788836524.996687:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770184448:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836524.996710:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770184448:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836524.996716:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:2.0:1788836524.996729:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788836524.996735:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770184704:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836524.996756:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770184704:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836524.996762:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788836524.996781:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184192 00000100:00100000:2.0:1788836524.996785:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184192 00000100:00100000:2.0:1788836524.996814:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 315 00000100:00100000:2.0:1788836524.996821:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770184192:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836524.996847:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770184192:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836524.996855:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 315 00000100:00080000:2.0:1788836524.996894:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836524.996899:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788836525.119579:0:13172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe94bdcc70 20000000:00000080:2.0:1788836525.119603:0:13172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adf7a716000 uarg=0000000000000000 20000000:01000000:2.0:1788836525.119688:0:13172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788836525.119699:0:13172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788836525.119705:0:13172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788836525.122761:0:13173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788836525.123273:0:13172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788836525.141385:0:13172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836525.141460:0:13172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.141482:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655405f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.141490:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655406d expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.141498:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655407b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.141505:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554089 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.143790:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.143801:0:13172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.143811:0:13172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144181:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144202:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 12 pid: 6485 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.144222:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850048:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836525.144360:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144369:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.144377:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850176:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836525.144427:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144436:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 23 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.144468:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850304:0@lo:104: 00000100:00100000:0.0:1788836525.144519:0:13172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836525.144895:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144906:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 23 pid: 6484 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.144915:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850432:0@lo:104: 00000100:00100000:0.0:1788836525.144940:0:13172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836525.144974:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.144981:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 23 pid: 6483 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.144989:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850560:0@lo:104: 00000100:00100000:0.0:1788836525.145042:0:13172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836525.145071:0:13172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836525.145079:0:13172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 23 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.145087:0:13172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850688:0@lo:104: 00000100:00100000:0.0:1788836525.145107:0:13172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836525.145117:0:13172:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836525.145264:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850304 00000100:00100000:1.0:1788836525.145273:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850304 00000100:00100000:1.0:1788836525.145330:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850432 00000100:00100000:1.0:1788836525.145334:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850432 00000100:00100000:1.0:1788836525.145344:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850560 00000100:00100000:1.0:1788836525.145347:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850560 00000100:00100000:1.0:1788836525.145355:0:7432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850688 00000100:00100000:1.0:1788836525.145357:0:7432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850688 00000100:00100000:1.0:1788836525.145374:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836525.145385:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:13172:x1875730782850304:12345-0@lo:104: 00010000:00010000:1.0:1788836525.145401:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145473:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836525.145480:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:13172:x1875730782850304:12345-0@lo:104: Request processed in 97us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.145488:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836525.145520:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836525.145539:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:13172:x1875730782850432:12345-0@lo:104: 00010000:00010000:1.0:1788836525.145548:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145586:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836525.145591:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:13172:x1875730782850432:12345-0@lo:104: Request processed in 65us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.145597:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836525.145610:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836525.145626:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:13172:x1875730782850560:12345-0@lo:104: 00010000:00010000:1.0:1788836525.145634:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145667:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788836525.145672:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:13172:x1875730782850560:12345-0@lo:104: Request processed in 57us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.145678:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836525.145690:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836525.145696:0:7432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:13172:x1875730782850688:12345-0@lo:104: 00010000:00010000:1.0:1788836525.145703:0:7432:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145730:0:7432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788836525.145735:0:7432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:13172:x1875730782850688:12345-0@lo:104: Request processed in 40us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.145740:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788836525.145770:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788836525.145777:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145785:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836525.145789:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145798:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836525.145805:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836525.145811:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836525.145844:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145852:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836525.145885:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145892:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47600/0xf7b38383a6554089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554090 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145903:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788836525.145906:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145911:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836525.145914:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145928:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836525.145933:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836525.145938:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836525.145953:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145959:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836525.145979:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145986:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43992a00/0xf7b38383a655407b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554082 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.145996:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836525.145999:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146005:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836525.146008:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146043:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836525.146050:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836525.146061:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836525.146093:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146100:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836525.146107:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146113:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade438f7a00/0xf7b38383a655406d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554074 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146121:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836525.146124:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146130:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836525.146133:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146140:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836525.146147:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836525.146153:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836525.146166:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146172:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836525.146184:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146190:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700400/0xf7b38383a655405f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554066 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146205:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836525.146207:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836525.146209:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836525.146216:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836525.146230:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782850816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.146267:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836525.146305:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836525.146310:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782851200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.146330:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836525.146355:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782850944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.146376:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836525.146393:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836525.146398:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782851072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.146416:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836525.146440:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850816 00000100:00100000:1.0:1788836525.146445:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850816 00010000:00010000:1.0:1788836525.146468:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 24 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.146485:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851200 00000100:00100000:1.0:1788836525.146487:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851200 00010000:00010000:1.0:1788836525.146496:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 25 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.146518:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782850944 00000100:00100000:1.0:1788836525.146521:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782850944 00010000:00010000:1.0:1788836525.146531:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 26 pid: 6484 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.146539:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851072 00000100:00100000:1.0:1788836525.146542:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851072 00010000:00010000:1.0:1788836525.146551:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 27 pid: 6483 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.146562:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836525.146568:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3617:x1875730782850816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.146583:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.146588:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 27 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146598:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 27 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146628:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836525.146660:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3617:x1875730782850816:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.146668:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836525.146683:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836525.146689:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3617:x1875730782851200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.146697:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.146702:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 26 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146721:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 26 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146732:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836525.146756:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3617:x1875730782851200:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.146763:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836525.146777:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836525.146784:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782850944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.146792:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.146796:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 25 pid: 6484 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146804:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 25 pid: 6484 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146814:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836525.146839:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782850944:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.146845:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836525.146857:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836525.146863:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782851072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.146871:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.146875:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 24 pid: 6483 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146884:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 24 pid: 6483 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.146899:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836525.146920:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782851072:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.146926:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836525.146970:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782851072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.146980:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782850944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.147008:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782851200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836525.147055:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782850816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836525.147352:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700a00/0xf7b38383a6554090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6554089 expref: 23 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.147375:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850304:0@lo:104: 00010000:00010000:0.0:1788836525.147391:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47a00/0xf7b38383a6554082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655407b expref: 22 pid: 6484 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.147399:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850432:0@lo:104: 00010000:00010000:0.0:1788836525.147470:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655406d expref: 21 pid: 6483 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.147480:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850560:0@lo:104: 00010000:00010000:0.0:1788836525.147492:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f6000/0xf7b38383a6554066 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655405f expref: 20 pid: 6485 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836525.147502:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850688:0@lo:104: 00010000:00010000:2.0:1788836525.148191:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836525.155128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836525.155246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836525.155395:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850048:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836525.155409:0:13172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13172:1875730782850176:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836525.155458:0:13172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.160382:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184832 00000100:00100000:1.0:1788836525.160411:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184832 00010000:00010000:1.0:1788836525.160484:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 13 pid: 6485 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.160539:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770184960 00000100:00100000:1.0:1788836525.160542:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770184960 00010000:00010000:1.0:1788836525.160555:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 14 pid: 6484 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836525.160572:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1788836525.160582:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+14:2394:x1875730770184832:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.160602:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.160608:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 14 pid: 6485 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.160637:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 14 pid: 6485 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.160679:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46600/0xf7b38383a65540ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1fd expref: 14 pid: 6485 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.160703:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836525.160893:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788836525.160905:0:6475:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788836525.162346:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770184832:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1750us (7214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.162364:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1788836525.162419:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1788836525.162436:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:2394:x1875730770184960:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836525.162461:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836525.162471:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162487:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162507:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f6800/0xf7b38383a6554097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1be expref: 12 pid: 6484 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162525:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162536:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162557:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162589:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162596:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162603:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162610:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836525.162625:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162634:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162652:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.162664:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836525.162721:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:2394:x1875730770184960:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 293us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836525.162728:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00010000:00010000:2.0:1788836525.163142:0:13172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.163153:0:13172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836525.163159:0:13172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836525.438555:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836525.825294:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836525.825325:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836525.825426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836525.827728:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851328 00000100:00100000:3.0:1788836525.827750:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851328 00000100:00100000:3.0:1788836525.827847:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788836525.827861:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782851328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836525.827916:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788836525.828053:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782851328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836525.828061:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788836525.828266:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836526.335835:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782851456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336079:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336189:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782851968:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336245:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336306:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782852480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336351:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336370:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782852992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336390:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336418:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836526.336425:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782851584:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336489:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336550:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782852096:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336650:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336669:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782852608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336692:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336724:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782851840:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336762:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336793:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782852352:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336841:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336869:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782852864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.336901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.336933:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836526.336954:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782851712:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.337071:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.337123:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782852224:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.337263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.337378:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782852736:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.337440:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.337556:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851968 00000100:00100000:1.0:1788836526.337653:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851968 00000100:00100000:1.0:1788836526.337747:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851712 00000100:00100000:1.0:1788836526.337751:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851712 00000100:00100000:1.0:1788836526.337770:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836526.337803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782851968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.337890:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782851968:12345-0@lo:400:kworker.0 Request processed in 110us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.337898:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836526.337917:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788836526.337924:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782851712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.337955:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782851712:12345-0@lo:400:kworker.0 Request processed in 32us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.337961:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788836526.337982:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851584 00000100:00100000:1.0:1788836526.337985:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851584 00000100:00100000:1.0:1788836526.338000:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852096 00000100:00100000:1.0:1788836526.338002:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852096 00000100:00100000:1.0:1788836526.338036:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852608 00000100:00100000:1.0:1788836526.338038:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852608 00000100:00100000:1.0:1788836526.338045:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851840 00000100:00100000:1.0:1788836526.338046:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851840 00000100:00100000:1.0:1788836526.338053:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852224 00000100:00100000:1.0:1788836526.338054:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852224 00000100:00100000:1.0:1788836526.338061:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852736 00000100:00100000:1.0:1788836526.338062:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852736 00000100:00100000:1.0:1788836526.338070:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788836526.338074:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782851584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338097:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782851584:12345-0@lo:400:kworker.0 Request processed in 23us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338108:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788836526.338116:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788836526.338120:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782852096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338138:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782852096:12345-0@lo:400:kworker.0 Request processed in 18us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338141:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788836526.338146:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788836526.338149:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782852608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338163:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782852608:12345-0@lo:400:kworker.0 Request processed in 14us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338167:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788836526.338172:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788836526.338175:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782851840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338189:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782851840:12345-0@lo:400:kworker.0 Request processed in 14us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338193:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788836526.338198:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788836526.338201:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782852224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338214:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782852224:12345-0@lo:400:kworker.0 Request processed in 13us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338218:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788836526.338223:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788836526.338226:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782852736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338238:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782852736:12345-0@lo:400:kworker.0 Request processed in 12us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.338246:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788836526.338283:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782851712:0@lo:400:kworker.0 00010000:00080000:1.0:1788836526.338293:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444ffb80 x1875730782852224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836526.338301:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782852224:0@lo:400:kworker.0 00010000:00080000:1.0:1788836526.338307:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebea00 x1875730782852736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836526.338312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782852736:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338318:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782851840:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338344:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782851584:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338349:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782852096:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338355:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782852608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836526.338362:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782851968:0@lo:400:kworker.0 00000100:00100000:2.0:1788836526.338795:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852480 00000100:00100000:2.0:1788836526.338801:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852480 00000100:00100000:2.0:1788836526.338837:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852992 00000100:00100000:2.0:1788836526.338840:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852992 00000100:00100000:2.0:1788836526.338848:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852352 00000100:00100000:2.0:1788836526.338850:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852352 00000100:00100000:2.0:1788836526.338859:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782852864 00000100:00100000:2.0:1788836526.338861:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782852864 00000100:00100000:2.0:1788836526.338870:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836526.338875:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782852480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836526.338921:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782852480:12345-0@lo:400:kworker.0 Request processed in 47us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.338926:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836526.338944:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836526.338948:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782852992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836526.338969:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782852992:12345-0@lo:400:kworker.0 Request processed in 21us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.338973:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836526.338980:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836526.338983:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782852352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836526.339004:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782852352:12345-0@lo:400:kworker.0 Request processed in 21us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.339008:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836526.339038:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788836526.339041:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782852864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836526.339069:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782852864:12345-0@lo:400:kworker.0 Request processed in 27us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.339073:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788836526.339088:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836526.339091:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836526.339094:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836526.339096:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788836526.339115:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444fce00 x1875730782852352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836526.339122:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782852352:0@lo:400:kworker.0 00010000:00080000:2.0:1788836526.339129:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebd180 x1875730782852864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836526.339134:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782852864:0@lo:400:kworker.0 00000100:00100000:0.0:1788836526.339395:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782851456 00000100:00100000:0.0:1788836526.339400:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782851456 00000100:00100000:0.0:1788836526.339430:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788836526.339435:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3614:x1875730782851456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836526.339466:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3614:x1875730782851456:12345-0@lo:400:kworker.0 Request processed in 30us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836526.339472:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788836526.339903:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836526.339944:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.340128:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782851456:0@lo:400:kworker.0 00010000:00080000:1.0:1788836526.340147:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a5500 x1875730782852480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836526.340157:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782852480:0@lo:400:kworker.0 00010000:00080000:1.0:1788836526.340168:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebf800 x1875730782852992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836526.340177:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782852992:0@lo:400:kworker.0 00000100:00100000:0.0:1788836526.340270:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853120 00000100:00100000:0.0:1788836526.340274:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853120 00000100:00100000:0.0:1788836526.340312:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836526.340320:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782853120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836526.340349:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836526.340445:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782853120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836526.340452:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1788836526.344795:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9b800 x1875730782853120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836526.345337:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782853120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836526.464175:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788836526.526187:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836526.526199:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7fbb1000 from 7 10000000:01000000:0.0:1788836526.526207:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836526.526293:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.526307:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.526322:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836526.526364:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.526478:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836526.526993:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853248 00000100:00100000:2.0:1788836526.527056:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853248 00000100:00100000:2.0:1788836526.527202:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788836526.527250:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782853248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836526.527284:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836526.527304:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65540d6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.527336:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.527347:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.527358:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46c00, rc 0) 00000100:00100000:2.0:1788836526.527428:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.527444:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788836526.529401:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836526.529460:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836526.529490:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.529505:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836526.529649:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.529715:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.529751:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836526.529919:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853376 00000100:00100000:3.0:1788836526.529929:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853376 00000100:00100000:3.0:1788836526.529989:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788836526.530000:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836526.530238:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836526.530259:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788836526.533054:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.533151:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.533251:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.533312:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836526.533462:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853504 00000100:00100000:1.0:1788836526.533472:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853504 00000100:00100000:1.0:1788836526.533552:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788836526.533564:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836526.533740:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.533748:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788836526.534294:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836526.535547:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788836526.535808:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788836526.535835:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836526.535849:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.535862:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836526.535874:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836526.535877:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7a54e000 from 7 10000000:01000000:0.0:1788836526.535880:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836526.535929:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.535937:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.535950:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836526.535986:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.536089:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.536127:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836526.536380:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853632 00000100:00100000:1.0:1788836526.536392:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853632 00000100:00100000:1.0:1788836526.536452:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788836526.536468:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782853632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836526.536484:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836526.536500:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65540e4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.536542:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.536554:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.536564:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:1.0:1788836526.536629:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782853632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836526.536636:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788836526.536900:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836526.536916:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.536926:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836526.536996:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.537067:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.537105:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836526.541607:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853760 00000100:00100000:3.0:1788836526.541640:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853760 00000100:00100000:3.0:1788836526.543077:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788836526.544515:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782853760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836526.544903:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782853760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (7833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.545114:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.545303:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.550034:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836526.550105:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836526.550147:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782853888 00000100:00100000:2.0:1788836526.550157:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782853888 00000100:00100000:3.0:1788836526.556247:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788836526.570870:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788836526.570923:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782853888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.571188:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782853888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (21180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.571197:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788836526.571282:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782853888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836526.582402:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788836526.582874:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788836526.582908:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836526.582923:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.582938:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836526.582951:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836526.582955:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf444f2000 from 7 10000000:01000000:2.0:1788836526.582958:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836526.583008:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.583041:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.583053:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836526.583087:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.583187:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836526.583240:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836526.583366:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854016 00000100:00100000:2.0:1788836526.583392:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854016 00000100:00100000:2.0:1788836526.583448:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788836526.589551:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782854016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836526.589588:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836526.589636:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65540f2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.589689:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.589702:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836526.589713:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47c00, rc 0) 00000100:00100000:2.0:1788836526.591083:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7614us (7884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.591098:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788836526.595612:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836526.595656:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836526.595673:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836526.595807:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.595884:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.595936:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836526.595966:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854144 00000100:00100000:0.0:1788836526.595975:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854144 00000100:00100000:0.0:1788836526.596069:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788836526.596079:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.597389:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1308us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836526.597398:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788836526.597470:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.597520:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836526.597579:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836526.597609:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836526.601063:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854272 00000100:00100000:2.0:1788836526.601087:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854272 00000100:00100000:2.0:1788836526.601185:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788836526.601200:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.601434:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.601441:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788836526.602296:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836526.614517:0:13189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788836526.618913:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788836526.619001:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836526.619065:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.619111:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836526.619127:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836526.619139:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf50b59800 from 7 10000000:01000000:1.0:1788836526.619143:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836526.619236:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.619246:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.619285:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836526.619339:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836526.619522:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.619644:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade438503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836526.623350:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854400 00000100:00100000:3.0:1788836526.623373:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854400 00000100:00100000:3.0:1788836526.623499:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788836526.623513:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782854400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836526.623536:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836526.623563:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6554100 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836526.623612:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6554100 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836526.623625:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554100 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836526.623658:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701c00, rc 0) 00000100:00100000:3.0:1788836526.623765:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782854400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (4241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836526.623772:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788836526.626336:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836526.626374:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.626389:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836526.626520:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836526.626626:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.626692:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade438503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836526.627004:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854528 00000100:00100000:2.0:1788836526.627024:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854528 00000100:00100000:2.0:1788836526.627089:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788836526.627101:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782854528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.627278:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782854528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.627287:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788836526.633311:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836526.633426:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836526.633543:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836526.633612:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade438503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836526.633681:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854656 00000100:00100000:2.0:1788836526.633690:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854656 00000100:00100000:2.0:1788836526.633765:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788836526.633777:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782854656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836526.633929:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782854656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.633937:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788836526.638195:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782854656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836526.644049:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788836526.644331:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788836526.644363:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836526.644378:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836526.644392:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836526.847164:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782854784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836526.847284:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836526.847378:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854784 00000100:00100000:2.0:1788836526.847389:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854784 00000100:00100000:2.0:1788836526.847449:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836526.847459:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782854784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836526.847490:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836526.847539:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782854784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836526.847547:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788836526.847611:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9c380 x1875730782854784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836526.847633:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782854784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836527.167486:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836527.170518:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185088 00000100:00100000:0.0:1788836527.170542:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185088 00000100:00100000:1.0:1788836527.170791:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 329 00000100:00100000:1.0:1788836527.170807:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:6171:x1875730770185088:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836527.170833:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836527.170862:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa22e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836527.170899:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836527.170913:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836527.170941:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992400, rc 0) 00000100:00100000:1.0:1788836527.171054:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185088:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 250us (3594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.171062:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 329 00000100:00100000:0.0:1788836527.178976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836527.179279:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185216 00000100:00100000:3.0:1788836527.179295:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185216 00000100:00100000:3.0:1788836527.179363:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 330 00000100:00100000:3.0:1788836527.179375:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185216:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836527.179591:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185216:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 209us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836527.179600:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 330 00000100:00100000:0.0:1788836527.182990:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836527.183191:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185344 00000100:00100000:1.0:1788836527.183205:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185344 00000100:00100000:1.0:1788836527.183287:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 331 00000100:00100000:1.0:1788836527.183299:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185344:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836527.183491:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185344:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 194us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.183501:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 331 00000100:00100000:1.0:1788836527.201197:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836527.202496:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185472 00000100:00100000:3.0:1788836527.202511:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185472 00000100:00100000:3.0:1788836527.202600:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 332 00000100:00100000:3.0:1788836527.202612:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770185472:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836527.202637:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836527.202664:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa235 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836527.202701:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836527.202890:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836527.202920:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701800, rc 0) 00000100:00100000:3.0:1788836527.203125:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770185472:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 514us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836527.203133:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 332 00000100:00100000:2.0:1788836527.219336:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836527.219386:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185600 00000100:00100000:2.0:1788836527.219418:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185600 00000100:00100000:2.0:1788836527.219506:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 333 00000100:00100000:2.0:1788836527.219519:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770185600:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836527.219727:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770185600:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 209us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836527.219736:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 333 00000100:00100000:1.0:1788836527.227451:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836527.229124:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185728 00000100:00100000:2.0:1788836527.229138:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185728 00000100:00100000:2.0:1788836527.229224:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 334 00000100:00100000:2.0:1788836527.229247:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770185728:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836527.229449:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770185728:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 205us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836527.229458:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 334 00010000:00010000:2.0:1788836527.487341:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836528.518481:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836528.898157:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782854912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836528.898254:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836528.898351:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782854912 00000100:00100000:1.0:1788836528.898359:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782854912 00000100:00100000:1.0:1788836528.898415:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788836528.898424:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782854912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836528.898467:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836528.898515:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782854912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836528.898521:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788836528.898586:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782854912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836529.536440:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836529.922311:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782855040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836529.922403:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836529.923358:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782855168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836529.923396:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836529.923447:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855040 00000100:00100000:3.0:1788836529.923455:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855040 00000100:00100000:3.0:1788836529.923512:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855168 00000100:00100000:3.0:1788836529.923514:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855168 00000100:00100000:3.0:1788836529.923530:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836529.923551:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782855040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836529.923586:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836529.923635:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782855040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.923642:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836529.923658:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836529.923663:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782855168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836529.923673:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836529.923694:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782855168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.923700:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788836529.923713:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836529.923746:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9b800 x1875730782855168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836529.923774:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782855168:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788836529.923891:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9c380 x1875730782855040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836529.923905:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782855040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836530.112909:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836530.112961:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836530.112999:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836530.113040:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836530.113060:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836530.113093:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185984 00000100:00100000:3.0:1788836530.113106:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185984 00000100:00100000:3.0:1788836530.113196:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186240 00000100:00100000:3.0:1788836530.113200:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186240 00000100:00100000:3.0:1788836530.113221:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186112 00000100:00100000:3.0:1788836530.113223:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186112 00000100:00100000:3.0:1788836530.113237:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186368 00000100:00100000:3.0:1788836530.113239:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186368 00000100:00100000:3.0:1788836530.113255:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:3.0:1788836530.113266:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770185984:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836530.113361:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770185984:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 97us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.113382:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:3.0:1788836530.113401:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:3.0:1788836530.113407:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186240:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836530.113436:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186240:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.113443:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:3.0:1788836530.113454:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:3.0:1788836530.113460:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770186112:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836530.113494:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770186112:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.113500:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:3.0:1788836530.113511:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:3.0:1788836530.113517:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186368:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836530.113553:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186368:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.113559:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:3.0:1788836530.113580:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770185856 00000100:00100000:3.0:1788836530.113583:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770185856 00000100:00100000:3.0:1788836530.113613:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 335 00000100:00100000:3.0:1788836530.113619:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770185856:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836530.113645:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770185856:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.113651:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 335 00000100:00080000:3.0:1788836530.113689:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836530.113694:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836530.558252:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836530.944807:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782855296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836530.945171:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836530.945994:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855296 00000100:00100000:2.0:1788836530.946006:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855296 00000100:00100000:2.0:1788836530.946103:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788836530.946114:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782855296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836530.946164:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836530.946227:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782855296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836530.946236:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788836530.946785:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782855296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836531.459220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782855424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.459309:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.459367:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782855936:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.459388:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782855680:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.459405:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.459439:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782856448:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.459471:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.459495:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.459535:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782856192:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.459546:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782856960:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.459593:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.459602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.459625:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782856704:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.459654:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788836531.459663:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.459685:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782855808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.459696:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788836531.459724:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782855552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.459739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836531.465601:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856448 00000100:00100000:2.0:1788836531.465633:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856448 00000100:00100000:2.0:1788836531.465708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856960 00000100:00100000:2.0:1788836531.465712:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856960 00000100:00100000:2.0:1788836531.465738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836531.465749:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782856448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.466753:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788836531.466849:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836531.466857:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836531.466884:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856192 00000100:00100000:3.0:1788836531.466894:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856192 00000100:00100000:3.0:1788836531.467041:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856704 00000100:00100000:3.0:1788836531.467047:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856704 00000100:00100000:3.0:1788836531.467196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855808 00000100:00100000:3.0:1788836531.467202:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855808 00000100:00100000:3.0:1788836531.467227:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855552 00000100:00100000:3.0:1788836531.467231:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855552 00000100:00100000:3.0:1788836531.467255:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788836531.467269:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782856192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.467357:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782856192:12345-0@lo:400:kworker.0 Request processed in 92us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.467366:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788836531.467389:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788836531.467397:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782856704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.468534:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782856704:12345-0@lo:400:kworker.0 Request processed in 1135us (8870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.468544:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788836531.468567:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788836531.468574:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.468608:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782855808:12345-0@lo:400:kworker.0 Request processed in 36us (8871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.468614:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788836531.468625:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788836531.468645:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.468677:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782855552:12345-0@lo:400:kworker.0 Request processed in 34us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.468683:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788836531.468719:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836531.468727:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782856960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.468779:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782856960:12345-0@lo:400:kworker.0 Request processed in 52us (9180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.468785:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788836531.470334:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836531.470664:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782855552:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.470683:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782856064:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.470747:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.470795:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856064 00000100:00100000:3.0:1788836531.470801:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856064 00000100:00100000:3.0:1788836531.470858:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788836531.470869:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782856064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.470915:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782856064:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.470923:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1788836531.471900:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836531.472039:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782856064:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.472055:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782856576:0@lo:400:kworker.0 00000100:00100000:3.0:1788836531.472108:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.473190:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856576 00000100:00100000:3.0:1788836531.473216:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856576 00000100:00100000:3.0:1788836531.473289:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788836531.473300:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782856576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.473555:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855424 00000100:00100000:0.0:1788836531.473570:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855424 00000100:00100000:0.0:1788836531.474794:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788836531.474810:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782855424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.474898:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782855424:12345-0@lo:400:kworker.0 Request processed in 94us (15591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.474906:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788836531.474948:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855936 00000100:00100000:0.0:1788836531.474954:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855936 00000100:00100000:0.0:1788836531.474983:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782855680 00000100:00100000:0.0:1788836531.474986:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782855680 00000100:00100000:0.0:1788836531.475000:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788836531.475006:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475062:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782855936:12345-0@lo:400:kworker.0 Request processed in 55us (15661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.475068:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788836531.475081:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788836531.475087:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475116:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782855680:12345-0@lo:400:kworker.0 Request processed in 29us (15647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.475133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788836531.475206:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782855808:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475217:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782856320:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.475275:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782856832:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475297:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.475318:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782855424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836531.475329:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782855936:0@lo:400:kworker.0 00010000:00080000:0.0:1788836531.475343:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920380 x1875730782856960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836531.475353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782856960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836531.477383:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782856448:12345-0@lo:400:kworker.0 Request processed in 11628us (17882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.477396:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836531.477425:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856320 00000100:00100000:2.0:1788836531.477432:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856320 00000100:00100000:2.0:1788836531.477476:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782856832 00000100:00100000:2.0:1788836531.477479:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782856832 00000100:00100000:2.0:1788836531.477494:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788836531.477501:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836531.477560:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782856320:12345-0@lo:400:kworker.0 Request processed in 60us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.477566:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788836531.477576:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836531.477582:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782856832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836531.477605:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782856832:12345-0@lo:400:kworker.0 Request processed in 24us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.477610:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788836531.478823:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836531.478830:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836531.478833:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836531.478851:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782857088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836531.478905:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836531.478948:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782855680:0@lo:400:kworker.0 00010000:00080000:2.0:1788836531.478978:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade41ebea00 x1875730782856192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836531.478988:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782856192:0@lo:400:kworker.0 00010000:00080000:2.0:1788836531.479005:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920a80 x1875730782856704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836531.479044:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782856704:0@lo:400:kworker.0 00000100:00100000:2.0:1788836531.479203:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857088 00000100:00100000:2.0:1788836531.479209:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857088 00000100:00100000:2.0:1788836531.479247:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836531.479255:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782857088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836531.479281:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836531.479317:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782856576:12345-0@lo:400:kworker.0 Request processed in 5833us (7026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.479331:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782857088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.479340:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788836531.479346:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836531.479403:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782856576:0@lo:400:kworker.0 00010000:00080000:2.0:1788836531.479414:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc98e00 x1875730782857088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836531.479427:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782857088:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788836531.480734:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43922d80 x1875730782856320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836531.480760:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782856320:0@lo:400:kworker.0 00010000:00080000:0.0:1788836531.480790:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43922300 x1875730782856832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836531.480798:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782856832:0@lo:400:kworker.0 00010000:00080000:0.0:1788836531.480811:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43923800 x1875730782856448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836531.480819:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782856448:0@lo:400:kworker.0 00010000:00010000:2.0:1788836531.594711:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836531.876786:0:13372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788836531.966296:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836531.966375:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782857216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836531.966472:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.967173:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857216 00000100:00100000:0.0:1788836531.967182:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857216 00000100:00100000:3.0:1788836531.973306:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836531.973321:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782857216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836531.973349:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788836531.973559:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43891500 x1875730782857216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836531.973582:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782857216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836531.973689:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782857216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 371us (7216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.973696:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00010000:3.0:1788836532.606287:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836533.630300:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836534.014332:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836534.014407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836534.014516:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857344 00000100:00100000:3.0:1788836534.014524:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857344 00000100:00100000:3.0:1788836534.014591:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788836534.014601:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782857344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836534.014635:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836534.030045:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782857344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15434us (15625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836534.030061:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788836534.039409:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782857344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788836534.659529:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836535.040388:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836535.040414:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782857472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836535.040504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836535.041273:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857472 00000100:00100000:0.0:1788836535.041282:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857472 00000100:00100000:3.0:1788836535.041415:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836535.041427:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782857600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836535.041477:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836535.041884:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836535.041906:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857600 00000100:00100000:2.0:1788836535.041911:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857600 00000100:00100000:0.0:1788836535.042157:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788836535.042169:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782857472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836535.042200:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836535.042250:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782857472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836535.042257:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1788836535.042345:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b1b800 x1875730782857472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836535.042365:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782857472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836535.043167:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836535.043486:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788836535.043501:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782857600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836535.043520:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836535.043724:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782857600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.043731:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788836535.044589:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fc000 x1875730782857600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836535.044611:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782857600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836535.231177:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836535.231232:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836535.231270:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836535.231302:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836535.231346:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836535.231378:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186752 00000100:00100000:2.0:1788836535.231390:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186752 00000100:00100000:2.0:1788836535.231461:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187008 00000100:00100000:2.0:1788836535.231465:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187008 00000100:00100000:2.0:1788836535.231486:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186624 00000100:00100000:2.0:1788836535.231489:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186624 00000100:00100000:2.0:1788836535.231503:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186880 00000100:00100000:2.0:1788836535.231506:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186880 00000100:00100000:2.0:1788836535.231524:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:2.0:1788836535.231533:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770186752:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836535.231811:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770186752:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 278us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.231820:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:2.0:1788836535.231841:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:2.0:1788836535.231849:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770187008:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836535.231892:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770187008:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.231900:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:2.0:1788836535.231913:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:2.0:1788836535.231920:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770186624:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836535.231945:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770186624:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.231952:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:2.0:1788836535.231965:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:2.0:1788836535.231972:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186880:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836535.231997:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770186880:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.232004:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:3.0:1788836535.232449:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770186496 00000100:00100000:3.0:1788836535.232456:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770186496 00000100:00100000:3.0:1788836535.232496:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 337 00000100:00100000:3.0:1788836535.232504:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770186496:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836535.232536:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770186496:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836535.232542:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 337 00000100:00080000:3.0:1788836535.232570:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836535.232574:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788836535.678255:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836536.066847:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782857728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836536.066937:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836536.067189:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857728 00000100:00100000:2.0:1788836536.067197:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857728 00000100:00100000:2.0:1788836536.067254:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788836536.067264:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782857728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836536.067310:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836536.067378:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782857728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836536.067385:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788836536.067751:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782857728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836536.576414:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782858112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576517:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576609:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782858624:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576634:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576658:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782859136:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576677:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576703:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836536.576709:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782858240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576729:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576743:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782858752:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576764:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576779:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782859264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576797:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576834:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782857856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576881:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782858368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576902:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576916:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782858880:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576949:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782859392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.576967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.576983:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788836536.576988:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782857984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.577008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836536.577043:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782858496:0@lo:400:kworker.0 00000100:00100000:3.0:1788836536.577055:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858624 00000100:00100000:1.0:1788836536.577061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836536.577063:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858624 00000100:00100000:1.0:1788836536.577077:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782859008:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.577094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836536.577106:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859136 00000100:00100000:1.0:1788836536.577108:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836536.577110:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859136 00000100:00100000:1.0:1788836536.577113:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836536.577122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858240 00000100:00100000:3.0:1788836536.577124:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858240 00000100:00100000:1.0:1788836536.577133:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836536.577134:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857984 00000100:00100000:3.0:1788836536.577136:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857984 00000100:00100000:3.0:1788836536.577145:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858496 00000100:00100000:3.0:1788836536.577147:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858496 00000100:00100000:1.0:1788836536.577156:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859008 00000100:00100000:1.0:1788836536.577158:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859008 00000100:00100000:3.0:1788836536.577161:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788836536.577177:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782858624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.577178:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788836536.577198:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782859136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836536.577231:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782858624:12345-0@lo:400:kworker.0 Request processed in 55us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836536.577238:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788836536.577253:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788836536.577259:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782858240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836536.577263:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858112 00000100:00100000:2.0:1788836536.577267:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858112 00000100:00100000:0.0:1788836536.577350:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859520 00000100:00100000:0.0:1788836536.577354:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859520 00000100:00100000:2.0:1788836536.577401:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858368 00000100:00100000:2.0:1788836536.577404:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858368 00000100:00100000:2.0:1788836536.577439:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788836536.577444:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.578101:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782859136:12345-0@lo:400:kworker.0 Request processed in 901us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.578108:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788836536.578133:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788836536.578140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782857984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.578192:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782857984:12345-0@lo:400:kworker.0 Request processed in 41us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.578198:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788836536.578211:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788836536.578217:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782858496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.578245:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782858496:12345-0@lo:400:kworker.0 Request processed in 29us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.578251:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788836536.578261:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788836536.578266:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782859008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.578302:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782859008:12345-0@lo:400:kworker.0 Request processed in 35us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.578308:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788836536.583195:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836536.583220:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782859520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836536.583257:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836536.583330:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782859520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (6195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.583337:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1788836536.583416:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fd180 x1875730782859520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836536.583450:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836536.583464:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782857984:0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.583474:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782858496:0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.583485:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782859008:0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.583555:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782857856 00000100:00100000:0.0:1788836536.583562:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782857856 00000100:00100000:0.0:1788836536.583613:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788836536.583620:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782857856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.583666:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782857856:12345-0@lo:400:kworker.0 Request processed in 35us (6792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.583673:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788836536.583700:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858752 00000100:00100000:0.0:1788836536.583703:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858752 00000100:00100000:0.0:1788836536.583718:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859264 00000100:00100000:0.0:1788836536.583720:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859264 00000100:00100000:0.0:1788836536.583740:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782858880 00000100:00100000:0.0:1788836536.583743:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782858880 00000100:00100000:0.0:1788836536.585700:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859392 00000100:00100000:0.0:1788836536.585713:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859392 00000100:00100000:0.0:1788836536.585833:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788836536.585842:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782858752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.585914:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782858752:12345-0@lo:400:kworker.0 Request processed in 74us (9148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.585921:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788836536.585948:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788836536.585955:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782859264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.585986:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782859264:12345-0@lo:400:kworker.0 Request processed in 31us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.585992:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788836536.586004:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836536.586026:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.586073:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782858880:12345-0@lo:400:kworker.0 Request processed in 63us (9137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.586079:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836536.586091:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836536.586098:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782859392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.586196:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782859392:12345-0@lo:400:kworker.0 Request processed in 98us (9227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.586202:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788836536.586247:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788836536.586256:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782858368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.586291:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782858368:12345-0@lo:400:kworker.0 Request processed in 37us (9387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.586297:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788836536.586343:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782857856:0@lo:400:kworker.0 00000100:00100000:0.0:1788836536.586358:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782858368:0@lo:400:kworker.0 00010000:00080000:0.0:1788836536.586372:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9e300 x1875730782858880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836536.586383:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782858880:0@lo:400:kworker.0 00010000:00080000:0.0:1788836536.586395:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcab800 x1875730782859392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836536.586405:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782859392:0@lo:400:kworker.0 00000100:00080000:0.0:1788836536.586511:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836536.586517:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836536.586527:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836536.587554:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782858112:12345-0@lo:400:kworker.0 Request processed in 10106us (11034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836536.587565:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788836536.599118:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782858240:12345-0@lo:400:kworker.0 Request processed in 21848us (22376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836536.599134:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788836536.599413:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782858240:0@lo:400:kworker.0 00010000:00080000:1.0:1788836536.599444:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9c380 x1875730782858752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836536.599455:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782858752:0@lo:400:kworker.0 00010000:00080000:1.0:1788836536.599467:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca9c00 x1875730782859264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836536.599475:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782859264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836536.599485:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782858112:0@lo:400:kworker.0 00010000:00080000:1.0:1788836536.599518:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc9dc00 x1875730782858624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836536.599535:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782858624:0@lo:400:kworker.0 00010000:00080000:1.0:1788836536.599549:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc98e00 x1875730782859136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836536.599566:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782859136:0@lo:400:kworker.0 00010000:00010000:2.0:1788836536.702241:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836537.089786:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836537.090047:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836537.090122:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836537.090189:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859648 00000100:00100000:0.0:1788836537.090196:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859648 00000100:00100000:0.0:1788836537.090246:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788836537.090255:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782859648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836537.090277:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836537.090320:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782859648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836537.090327:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788836537.090366:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43890e00 x1875730782859648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836537.090385:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782859648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836537.726577:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836538.750728:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836539.139234:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782859776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836539.139320:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836539.139469:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859776 00000100:00100000:1.0:1788836539.139478:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859776 00000100:00100000:1.0:1788836539.139530:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788836539.139539:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782859776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836539.139574:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836539.139638:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782859776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836539.139645:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788836539.140366:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782859776:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788836539.693293:0:13521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:02:17 (1788836537) === 00010000:00010000:1.0:1788836539.775993:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836540.049620:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.049667:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.049748:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187136 00000100:00100000:1.0:1788836540.049760:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187136 00000100:00100000:1.0:1788836540.049853:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:1.0:1788836540.049864:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770187136:12345-192.168.201.38@tcp:41:mkdir.0 00000004:00000024:1.0:1788836540.049904:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788836540.049984:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770187136:12345-192.168.201.38@tcp:41:mkdir.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836540.049992:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00080000:2.0:1788836540.050277:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836540.052034:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187264 00000100:00100000:0.0:1788836540.052047:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187264 00000100:00100000:0.0:1788836540.052149:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1788836540.052160:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:10508:x1875730770187264:12345-192.168.201.38@tcp:700:mkdir.0 00000100:00100000:0.0:1788836540.052245:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:10508:x1875730770187264:12345-192.168.201.38@tcp:700:mkdir.0 Request processed in 87us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.052253:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788836540.054351:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.054463:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187520 00000100:00100000:3.0:1788836540.054472:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187520 00000100:00100000:3.0:1788836540.054527:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:3.0:1788836540.054535:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:10508:x1875730770187520:12345-192.168.201.38@tcp:36:mkdir.0 00010000:00010000:3.0:1788836540.054590:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836540.054648:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6553fbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1a9 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054669:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:3.0:1788836540.054680:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836540.054763:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054777:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054813:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054840:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054849:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.054855:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055479:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055492:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055499:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836540.055512:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000657de908 reply state 00000000a9ca1d2d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055523:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055530:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:3.0:1788836540.055533:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836540.055536:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788836540.055540:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788836540.055555:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055562:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055568:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055574:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836540.055579:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055586:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055596:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf5321e300) 00010000:00010000:3.0:1788836540.055598:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836540.055602:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055609:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a655411c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836540.055622:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000657de908 reply state 00000000a9ca1d2d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055630:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.055635:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf5321eb00) 00010000:00010000:3.0:1788836540.055637:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836540.055644:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788836540.055748:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:10508:x1875730770187520:12345-192.168.201.38@tcp:36:mkdir.0 Request processed in 1211us (1403us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788836540.055757:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:3.0:1788836540.065764:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.067041:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187648 00000100:00100000:0.0:1788836540.067067:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187648 00000100:00100000:0.0:1788836540.067126:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788836540.067137:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:10509:x1875730770187648:12345-192.168.201.38@tcp:101:chmod.0 00010000:00010000:0.0:1788836540.067158:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836540.067183:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa23c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067270:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067284:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067294:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836540.067339:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836540.067343:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836540.067389:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067417:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa23c expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067864:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa23c expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.067873:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819600) 00010000:00010000:0.0:1788836540.067876:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836540.067879:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836540.067958:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:10509:x1875730770187648:12345-192.168.201.38@tcp:101:chmod.0 Request processed in 822us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.067966:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788836540.070761:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.070911:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770187904 00000100:00100000:1.0:1788836540.070934:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770187904 00000100:00100000:1.0:1788836540.071057:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:1.0:1788836540.071067:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:10509:x1875730770187904:12345-192.168.201.38@tcp:36:chmod.0 00010000:00010000:1.0:1788836540.071119:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836540.071145:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa23c expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.071162:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819600) 00010000:00010000:1.0:1788836540.071171:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836540.071199:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.071211:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.071221:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836540.071448:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b9f8df reply state 000000001942669c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.071461:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.071469:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:1.0:1788836540.071471:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788836540.071474:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788836540.071480:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788836540.071556:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:10509:x1875730770187904:12345-192.168.201.38@tcp:36:chmod.0 Request processed in 490us (803us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788836540.071562:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788836540.100108:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.100242:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188032 00000100:00100000:3.0:1788836540.100265:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188032 00000100:00100000:3.0:1788836540.100328:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:3.0:1788836540.100339:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:10510:x1875730770188032:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:3.0:1788836540.100376:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836540.100397:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa243 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100480:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100495:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100509:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836540.100548:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836540.100552:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836540.100591:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100619:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa243 expref: 11 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100658:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa243 expref: 10 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.100667:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:3.0:1788836540.100670:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836540.100674:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836540.100856:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:10510:x1875730770188032:12345-192.168.201.38@tcp:101:chown.0 Request processed in 518us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836540.100865:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:0.0:1788836540.104190:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.104332:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188160 00000100:00100000:3.0:1788836540.104342:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188160 00000100:00100000:3.0:1788836540.104446:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836540.104456:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:10510:x1875730770188160:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:3.0:1788836540.104479:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836540.104499:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa24a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104561:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104575:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104586:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104597:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104618:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104625:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104704:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104713:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104721:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836540.104769:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836540.104773:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836540.104868:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104880:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104887:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104893:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104898:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836540.104902:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104917:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104931:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:3.0:1788836540.104934:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836540.104939:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104945:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a655415b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104959:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104964:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104970:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104975:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836540.104978:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104984:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.104991:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf5321eb00) 00010000:00010000:3.0:1788836540.104994:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836540.104997:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.105222:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.105322:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa24a expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.105339:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa24a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.105346:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:3.0:1788836540.105348:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836540.105351:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:2.0:1788836540.105685:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10510:x1875730770188160:12345-192.168.201.38@tcp:101:chown.0 Request processed in 1226us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.105694:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1788836540.108417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.108494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188288 00000100:00100000:1.0:1788836540.108503:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188288 00000100:00100000:1.0:1788836540.108557:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788836540.108567:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10510:x1875730770188288:12345-192.168.201.38@tcp:900:chown.0 00000100:00100000:1.0:1788836540.108644:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10510:x1875730770188288:12345-192.168.201.38@tcp:900:chown.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836540.108651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788836540.111266:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.111341:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188544 00000100:00100000:3.0:1788836540.111350:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188544 00000100:00100000:3.0:1788836540.111431:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1788836540.111440:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10510:x1875730770188544:12345-192.168.201.38@tcp:36:chown.0 00010000:00010000:3.0:1788836540.111492:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836540.111518:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa24a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.111537:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:3.0:1788836540.111542:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836540.111563:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.111575:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.111602:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836540.116635:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788836540.116757:0:12185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1473210 reply state 00000000a774650d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.116783:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.116794:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:0.0:1788836540.116797:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788836540.116802:0:12185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788836540.116815:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836540.116830:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116849:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116858:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116866:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.116872:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116882:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116901:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf5321eb00) 00010000:00010000:2.0:1788836540.116905:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00080000:0.0:1788836540.116921:0:12185:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1788836540.116932:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116941:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554123 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836540.116944:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:10510:x1875730770188544:12345-192.168.201.38@tcp:36:chown.0 Request processed in 5498us (5689us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788836540.116965:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00010000:00010000:2.0:1788836540.116983:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.116994:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117000:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117054:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.117059:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117066:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117080:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:2.0:1788836540.117083:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836540.117087:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117093:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655412a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117111:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117118:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117131:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117137:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.117141:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117148:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117158:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:2.0:1788836540.117161:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788836540.117164:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.117171:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655413f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117579:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117591:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117597:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117604:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836540.117608:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117616:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117630:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf5321ee00) 00010000:00010000:1.0:1788836540.117633:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788836540.117638:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.117644:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554170 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836540.160912:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836540.160939:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782859904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836540.161056:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836540.161137:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836540.161161:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836540.161244:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782859904 00000100:00100000:2.0:1788836540.161257:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782859904 00000100:00100000:2.0:1788836540.161354:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860032 00000100:00100000:2.0:1788836540.161394:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860032 00000100:00100000:2.0:1788836540.161444:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788836540.161556:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836540.161602:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782859904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836540.161645:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836540.161795:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782859904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 198us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.163988:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836540.164028:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782860032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836540.164058:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836540.164130:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782860032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.164138:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788836540.164647:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439fca80 x1875730782859904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836540.164683:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782859904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836540.169985:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00080000:0.0:1788836540.171313:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca9500 x1875730782860032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836540.171340:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836540.171771:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188672 00000100:00100000:1.0:1788836540.171779:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188672 00000100:00100000:1.0:1788836540.171838:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1788836540.171847:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:10511:x1875730770188672:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:1.0:1788836540.171869:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836540.171889:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa251 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836540.174007:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000004:00080000:3.0:1788836540.175210:0:10681:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3268us 00010000:00010000:1.0:1788836540.200926:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.200949:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.200960:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.200976:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.200991:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.200997:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201159:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201169:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201176:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836540.201208:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788836540.201211:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836540.201247:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201259:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201265:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201273:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201279:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836540.201283:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201296:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201309:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:1.0:1788836540.201313:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836540.201317:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201323:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992e00/0xf7b38383a655417e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201334:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201339:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201346:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201351:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836540.201353:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201370:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201377:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf7a535a00) 00010000:00010000:1.0:1788836540.201379:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836540.201382:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201398:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201435:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa251 expref: 8 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201448:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa251 expref: 7 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.201456:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:1.0:1788836540.201459:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836540.201461:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993400, rc 0) 00000100:00100000:1.0:1788836540.201528:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:10511:x1875730770188672:12345-192.168.201.38@tcp:101:touch.500 Request processed in 29681us (31551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836540.201537:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1788836540.204966:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.205072:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770188928 00000100:00100000:0.0:1788836540.205082:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770188928 00000100:00100000:0.0:1788836540.205135:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:0.0:1788836540.205148:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:10511:x1875730770188928:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:0.0:1788836540.205168:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836540.205187:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554193 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa258 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205296:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205318:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205329:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205387:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205394:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205402:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836540.205744:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788836540.205888:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65541a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205897:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65541a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205911:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65541a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205940:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205948:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205955:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205961:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836540.205965:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205973:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205984:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:0.0:1788836540.205986:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836540.205990:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.205997:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655419a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836540.206065:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa90b382 reply state 00000000c322d22e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.206076:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.206088:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff8ade43819000) 00010000:00010000:0.0:1788836540.206091:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836540.206093:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788836540.206119:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554193 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa258 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.206133:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65541a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa258 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.206141:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ade43819200) 00010000:00010000:0.0:1788836540.206143:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836540.206145:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836540.206202:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:10511:x1875730770188928:12345-192.168.201.38@tcp:101:touch.500 Request processed in 1058us (1245us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788836540.206208:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836540.218078:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.218435:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189184 00000100:00100000:1.0:1788836540.218446:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189184 00000100:00100000:1.0:1788836540.218510:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1788836540.218521:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:10511:x1875730770189184:12345-192.168.201.38@tcp:36:touch.500 00010000:00010000:1.0:1788836540.218580:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836540.218612:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65541a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa258 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.218631:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ade43819200) 00010000:00010000:1.0:1788836540.218643:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836540.219179:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.219204:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.219213:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836540.219320:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae74a7d4 reply state 000000000ccaa9df transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.219332:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836540.219339:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:1.0:1788836540.219342:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836540.219345:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836540.219469:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10511:x1875730770189184:12345-192.168.201.38@tcp:36:touch.500 Request processed in 948us (1400us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788836540.219477:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1788836540.229949:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.230061:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189312 00000100:00100000:0.0:1788836540.230072:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189312 00000100:00100000:0.0:1788836540.230123:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1788836540.230133:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:10511:x1875730770189312:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:0.0:1788836540.230158:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836540.230180:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65541bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa25f expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.230236:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65541bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa25f expref: 12 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.230249:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65541bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa25f expref: 12 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.230285:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:0.0:1788836540.230288:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836540.230293:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836540.230371:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:10511:x1875730770189312:12345-192.168.201.38@tcp:101:touch.500 Request processed in 239us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.230379:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:3.0:1788836540.235911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.236040:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189440 00000100:00100000:0.0:1788836540.236050:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189440 00000100:00100000:0.0:1788836540.236099:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788836540.236108:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8174b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875730770189440:12345-192.168.201.38@tcp:8:touch.500 00010000:00080000:0.0:1788836540.236141:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:0.0:1788836540.236170:0:8405:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a65541c4 00002000:00100000:0.0:1788836540.236182:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b8fbf20-a55f-40bb-87b6-19e878cca24b/ffff8adf7fc1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836540.236199:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788836540.236286:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836540.236310:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836540.236382:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8174b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770189440:12345-192.168.201.38@tcp:8:touch.500 Request processed in 274us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.236390:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788836540.238794:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.238919:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189568 00000100:00100000:0.0:1788836540.238928:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189568 00000100:00100000:0.0:1788836540.238996:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1788836540.239005:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770189568:12345-192.168.201.38@tcp:2:touch.500 00000100:00080000:1.0:1788836540.239248:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788836540.251397:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788836540.251412:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000100:00100000:0.0:1788836540.251676:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:0:x1875730770189568:12345-192.168.201.38@tcp:2:touch.500 Request processed in 12666us (12895us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788836540.251697:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:3.0:1788836540.263179:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.263289:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189824 00000100:00100000:1.0:1788836540.263300:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189824 00000100:00100000:1.0:1788836540.263436:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1788836540.263446:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:10511:x1875730770189824:12345-192.168.201.38@tcp:35:touch.500 00000100:00100000:1.0:1788836540.263715:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:10511:x1875730770189824:12345-192.168.201.38@tcp:35:touch.500 Request processed in 270us (544us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788836540.263723:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788836540.280061:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.280190:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770189952 00000100:00100000:2.0:1788836540.280206:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770189952 00000100:00100000:2.0:1788836540.280264:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788836540.280273:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:10512:x1875730770189952:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1788836540.280296:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836540.280315:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a65541cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa266 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280391:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280405:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280416:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836540.280471:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836540.280475:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836540.280509:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280535:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a65541cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa266 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280551:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa266 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.280560:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:2.0:1788836540.280563:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836540.280567:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46000, rc 0) 00000100:00100000:2.0:1788836540.280625:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:10512:x1875730770189952:12345-192.168.201.38@tcp:101:rm.0 Request processed in 353us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.280633:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1788836540.288135:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.288223:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770190208 00000100:00100000:0.0:1788836540.288232:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770190208 00000100:00100000:0.0:1788836540.288292:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1788836540.288302:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:10512:x1875730770190208:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:0.0:1788836540.288323:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836540.288341:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65541d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa26d expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836540.288455:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788836540.288596:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65541d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa26d expref: 16 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.288611:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:0.0:1788836540.288614:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836540.288619:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65541d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa26d expref: 16 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.288632:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6800, rc 0) 00000100:00100000:0.0:1788836540.288691:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:10512:x1875730770190208:12345-192.168.201.38@tcp:101:rm.0 Request processed in 389us (566us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788836540.288698:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1788836540.310114:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.310213:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770190336 00000100:00100000:0.0:1788836540.310223:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770190336 00000100:00100000:0.0:1788836540.310287:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788836540.310297:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:10512:x1875730770190336:12345-192.168.201.38@tcp:37:rm.0 00000100:00100000:1.0:1788836540.325361:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:10512:x1875730770190336:12345-192.168.201.38@tcp:37:rm.0 Request processed in 15046us (15238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836540.325391:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1788836540.327923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836540.328301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770190592 00000100:00100000:1.0:1788836540.328312:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770190592 00000100:00100000:1.0:1788836540.328379:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1788836540.328389:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:10512:x1875730770190592:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:1.0:1788836540.329373:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:10512:x1875730770190592:12345-192.168.201.38@tcp:35:rm.0 Request processed in 982us (1455us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788836540.329382:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1788836540.333573:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.333672:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770190848 00000100:00100000:2.0:1788836540.333683:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770190848 00000100:00100000:2.0:1788836540.333758:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788836540.333770:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:10512:x1875730770190848:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1788836540.333804:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836540.333825:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a65541e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa274 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.333939:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47000/0xf7b38383a65541ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.333955:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47000/0xf7b38383a65541ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.333965:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47000/0xf7b38383a65541ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836540.333977:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836540.334161:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a65541e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa274 expref: 19 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.334180:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47000/0xf7b38383a65541ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa274 expref: 18 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.334189:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:2.0:1788836540.334193:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836540.334203:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47000, rc 0) 00000100:00100000:2.0:1788836540.334272:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770190848:12345-192.168.201.38@tcp:101:rm.0 Request processed in 503us (709us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788836540.334279:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1788836540.349346:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.349462:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770190976 00000100:00100000:2.0:1788836540.349472:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770190976 00000100:00100000:2.0:1788836540.349528:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1788836540.349546:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770190976:12345-192.168.201.38@tcp:41:rm.0 00000004:00000024:2.0:1788836540.349602:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788836540.349895:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770190976:12345-192.168.201.38@tcp:41:rm.0 Request processed in 353us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.349903:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1788836540.355100:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.355207:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191104 00000100:00100000:2.0:1788836540.355217:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191104 00000100:00100000:3.0:1788836540.355629:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.356502:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191360 00000100:00100000:0.0:1788836540.356509:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191360 00000100:00100000:0.0:1788836540.356560:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:0.0:1788836540.356570:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770191360:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:0.0:1788836540.356589:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836540.356607:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65541fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa27b expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356664:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356678:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356689:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356701:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356709:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356716:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356956:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356982:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.356989:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836540.357044:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788836540.357049:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836540.357066:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357078:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357087:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357094:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357101:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357106:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836540.357111:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357118:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357129:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:0.0:1788836540.357138:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836540.357143:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357148:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357160:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357166:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357172:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357177:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836540.357179:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357186:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357192:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff8ade43819000) 00010000:00010000:0.0:1788836540.357195:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836540.357198:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357204:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655420a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357228:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65541fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa27b expref: 20 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357264:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa27b expref: 19 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836540.357272:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:0.0:1788836540.357274:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836540.357276:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836540.357331:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:10512:x1875730770191360:12345-192.168.201.38@tcp:101:rm.0 Request processed in 762us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.357338:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1788836540.357569:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 339 00000100:00100000:2.0:1788836540.357580:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770191104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836540.357619:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770191104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.357626:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 339 00000100:00100000:0.0:1788836540.362081:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.362607:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191616 00000100:00100000:2.0:1788836540.362617:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191616 00000100:00100000:2.0:1788836540.362710:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1788836540.362720:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:10512:x1875730770191616:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:2.0:1788836540.362895:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836540.362919:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa27b expref: 19 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.362960:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65541bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa25f expref: 18 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.362970:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:2.0:1788836540.362979:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a65541d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa266 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.362988:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:2.0:1788836540.362991:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836540.363037:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363051:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363060:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363071:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363078:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363085:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363171:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363187:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363195:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836540.363670:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788836540.363684:0:10333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324269671236ns, next at 325269668491ns, rc = 0 00010000:00010000:2.0:1788836540.363728:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.363738:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836540.364460:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:2.0:1788836540.364750:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364760:0:10333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364767:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364773:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364841:0:10333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836540.364863:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364870:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364896:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364902:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.364907:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364914:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364926:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:2.0:1788836540.364929:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788836540.364933:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364939:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a6554226 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364958:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364964:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364971:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364975:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.364977:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364990:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.364998:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:2.0:1788836540.365001:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836540.365003:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.365022:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46e00/0xf7b38383a6554218 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836540.365033:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7734057 reply state 00000000b8dbdc9a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.365044:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.365050:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff8ade43819000) 00010000:00010000:2.0:1788836540.365052:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836540.365055:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836540.365120:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770191616:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2400us (3113us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788836540.365129:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788836540.365733:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.365765:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.365797:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191232 00000100:00100000:2.0:1788836540.365806:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191232 00000100:00100000:2.0:1788836540.365847:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:2.0:1788836540.365855:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770191232:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836540.365907:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770191232:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 53us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.365923:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 218 00010000:00010000:3.0:1788836540.368181:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836540.368195:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.368205:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836540.368210:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.368236:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.368263:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:3.0:1788836540.368266:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836540.368271:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.368277:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46400/0xf7b38383a655422d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836540.368292:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836540.368293:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836540.368295:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836540.368579:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836540.369398:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191744 00000100:00100000:2.0:1788836540.369408:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191744 00000100:00100000:2.0:1788836540.369480:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:2.0:1788836540.369490:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770191744:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836540.369555:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770191744:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 67us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.369562:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:0.0:1788836540.370648:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836540.370717:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836540.372160:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192256 00000100:00100000:3.0:1788836540.372173:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192256 00000100:00100000:3.0:1788836540.372234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1788836540.372242:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770192256:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:3.0:1788836540.372492:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:10512:x1875730770192256:12345-192.168.201.38@tcp:35:rm.0 Request processed in 244us (1768us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788836540.372500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788836540.375108:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836540.375526:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770191872 00000100:00100000:2.0:1788836540.375535:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770191872 00000100:00100000:2.0:1788836540.375594:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192000 00000100:00100000:2.0:1788836540.375597:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192000 00000100:00100000:2.0:1788836540.375613:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192512 00000100:00100000:2.0:1788836540.375615:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192512 00000100:00100000:2.0:1788836540.375634:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:2.0:1788836540.375643:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770191872:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836540.375709:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770191872:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 67us (9943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.375716:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:2.0:1788836540.375732:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:2.0:1788836540.375737:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770192000:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836540.375770:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770192000:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836540.375876:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:2.0:1788836540.375945:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788836540.375964:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:10512:x1875730770192512:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:2.0:1788836540.376008:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836540.376067:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47000/0xf7b38383a65541ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa274 expref: 19 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376087:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655418c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa251 expref: 18 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376098:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf7a535c00) 00010000:00010000:2.0:1788836540.376112:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a655414d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa243 expref: 17 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376121:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf7a535500) 00010000:00010000:2.0:1788836540.376126:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836540.376152:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376165:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376174:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376186:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376192:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376198:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376349:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376368:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.376375:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788836540.376619:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836540.376624:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788836540.378311:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836540.378332:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378342:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378350:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378367:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.378372:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378379:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378393:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8adf43d52a00) 00010000:00010000:2.0:1788836540.378396:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788836540.378400:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378533:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46a00/0xf7b38383a6554242 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378560:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378567:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378573:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378577:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836540.378580:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378586:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378594:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf43d52500) 00010000:00010000:2.0:1788836540.378596:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836540.378599:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378606:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46000/0xf7b38383a6554234 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836540.378615:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ebc9e1 reply state 0000000002745382 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378627:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836540.378640:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf43d52400) 00010000:00010000:2.0:1788836540.378642:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836540.378645:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836540.378753:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:10512:x1875730770192512:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2779us (3642us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788836540.378761:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00010000:00010000:3.0:1788836540.800502:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836541.182505:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836541.182576:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836541.182987:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860160 00000100:00100000:2.0:1788836541.182997:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860160 00000100:00100000:2.0:1788836541.183067:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788836541.183077:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782860160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836541.183108:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836541.183162:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782860160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836541.183169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788836541.183249:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836541.694726:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782860544:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.694838:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.694911:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861056:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.694942:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.694963:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861568:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695052:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.695083:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788836541.695091:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782860416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.695397:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782860928:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.695447:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782861440:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836541.695512:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860544 00000100:00100000:0.0:1788836541.695522:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860544 00000100:00100000:0.0:1788836541.695588:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860416 00000100:00100000:0.0:1788836541.695591:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860416 00000100:00100000:0.0:1788836541.695611:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860928 00000100:00100000:0.0:1788836541.695613:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860928 00000100:00100000:0.0:1788836541.695636:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861440 00000100:00100000:0.0:1788836541.695639:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861440 00000100:00100000:0.0:1788836541.695662:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788836541.695672:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782860544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695737:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782860544:12345-0@lo:400:kworker.0 Request processed in 66us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.695745:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788836541.695782:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788836541.695789:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782860416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695819:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782860416:12345-0@lo:400:kworker.0 Request processed in 30us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.695825:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788836541.695838:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788836541.695854:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782860928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695885:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782860928:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.695892:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788836541.695903:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788836541.695909:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782861440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.695937:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782861440:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.695944:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788836541.695965:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861056 00000100:00100000:0.0:1788836541.695969:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861056 00000100:00100000:0.0:1788836541.695998:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861568 00000100:00100000:0.0:1788836541.696001:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861568 00000100:00100000:0.0:1788836541.696051:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788836541.696058:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.696094:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861056:12345-0@lo:400:kworker.0 Request processed in 36us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.696100:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788836541.696112:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836541.696117:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696399:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782860672:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696442:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.696470:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861184:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696492:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.696513:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696536:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.696552:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836541.696558:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782860288:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696587:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.696611:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782860800:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696635:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.696653:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782861312:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696675:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836541.696737:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836541.696743:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836541.696755:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860800 00000100:00100000:1.0:1788836541.696759:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860800 00000100:00100000:1.0:1788836541.696789:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861312 00000100:00100000:1.0:1788836541.696792:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861312 00000100:00100000:1.0:1788836541.696809:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788836541.696815:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782860800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696852:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782860800:12345-0@lo:400:kworker.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.696858:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788836541.696873:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788836541.696878:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782861312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.696905:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782861312:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.696911:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788836541.696933:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861184 00000100:00100000:1.0:1788836541.696937:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861184 00000100:00100000:1.0:1788836541.696952:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861696 00000100:00100000:1.0:1788836541.696955:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861696 00000100:00100000:1.0:1788836541.696969:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836541.696975:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.697007:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861184:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.697037:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836541.697050:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788836541.697056:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.697085:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861696:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.697098:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000004:00080000:1.0:1788836541.698418:0:10026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325604402854ns, next at 326604399366ns, rc = 0 00000100:00080000:1.0:1788836541.698451:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836541.698457:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836541.698509:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782860800:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.698524:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782861312:0@lo:400:kworker.0 00010000:00080000:1.0:1788836541.698542:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f3100 x1875730782861184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836541.698553:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861184:0@lo:400:kworker.0 00010000:00080000:1.0:1788836541.698564:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc26680 x1875730782861696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836541.698572:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.698596:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836541.698611:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836541.698667:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836541.698727:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782860416:0@lo:400:kworker.0 00010000:00080000:1.0:1788836541.698743:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f3800 x1875730782860928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836541.698766:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782860928:0@lo:400:kworker.0 00010000:00080000:1.0:1788836541.698781:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f2a00 x1875730782861440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836541.698788:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782861440:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.698817:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782860544:0@lo:400:kworker.0 00010000:00080000:1.0:1788836541.698831:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade437f3480 x1875730782861056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836541.698839:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861056:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.698902:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860672 00000100:00100000:1.0:1788836541.698910:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860672 00000100:00100000:1.0:1788836541.698961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788836541.698969:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782860672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.699054:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782860672:12345-0@lo:400:kworker.0 Request processed in 86us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.699062:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788836541.699108:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782860672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836541.700849:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861568:12345-0@lo:400:kworker.0 Request processed in 4719us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.700866:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788836541.700915:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861824 00000100:00100000:0.0:1788836541.700925:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861824 00000100:00100000:0.0:1788836541.700970:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788836541.700978:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836541.701033:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836541.701087:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782861824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836541.701094:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1788836541.701462:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc27b80 x1875730782861568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836541.701479:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861568:0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.703883:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782860288 00000100:00100000:1.0:1788836541.703901:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782860288 00010000:00080000:0.0:1788836541.704383:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c5500 x1875730782861824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836541.704412:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782861824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836541.704517:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788836541.704529:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782860288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836541.704638:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782860288:12345-0@lo:400:kworker.0 Request processed in 111us (8050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.704646:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788836541.704894:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782860288:0@lo:400:kworker.0 00010000:00010000:1.0:1788836541.823923:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836542.206401:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836542.206427:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836542.206503:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836542.206736:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782861952 00000100:00100000:0.0:1788836542.206756:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782861952 00000100:00100000:0.0:1788836542.206811:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836542.206821:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836542.206853:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836542.206913:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782861952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836542.206920:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788836542.207197:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf8155f480 x1875730782861952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836542.207227:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782861952:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836542.853391:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836543.871509:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836544.278391:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782862080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836544.278474:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836544.278725:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862080 00000100:00100000:1.0:1788836544.278749:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862080 00000100:00100000:1.0:1788836544.278800:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788836544.278809:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782862080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836544.278844:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836544.278896:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782862080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836544.278903:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788836544.278948:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782862080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788836544.894331:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836545.278184:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836545.278206:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782862208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836545.278309:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836545.278375:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862208 00000100:00100000:3.0:1788836545.278383:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862208 00000100:00100000:3.0:1788836545.278437:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788836545.278446:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782862208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836545.278474:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836545.278517:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782862208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836545.278525:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788836545.278545:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836545.278573:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4390b100 x1875730782862208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836545.278592:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782862208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836545.281530:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836545.281554:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782862336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836545.281635:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836545.281695:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862336 00000100:00100000:2.0:1788836545.281702:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862336 00000100:00100000:2.0:1788836545.281759:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836545.281767:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782862336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836545.281789:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836545.281827:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782862336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836545.281833:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1788836545.281879:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcaaa00 x1875730782862336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836545.281897:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782862336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836545.282082:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836545.482913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.482952:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.482977:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.482996:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.483046:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.483071:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836545.483097:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192896 00000100:00100000:0.0:1788836545.483107:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192896 00000100:00100000:0.0:1788836545.483162:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193152 00000100:00100000:0.0:1788836545.483165:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193152 00000100:00100000:0.0:1788836545.483195:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192768 00000100:00100000:0.0:1788836545.483198:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192768 00000100:00100000:0.0:1788836545.483209:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193280 00000100:00100000:0.0:1788836545.483211:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193280 00000100:00100000:0.0:1788836545.483227:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:0.0:1788836545.483236:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770192896:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836545.483322:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770192896:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 86us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.483330:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:0.0:1788836545.483348:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:0.0:1788836545.483354:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770193152:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836545.483379:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770193152:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.483386:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:0.0:1788836545.483396:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:0.0:1788836545.483402:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770192768:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836545.483428:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770192768:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.483434:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:0.0:1788836545.483445:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:0.0:1788836545.483451:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770193280:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836545.483473:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770193280:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.483479:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:0.0:1788836545.483502:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193024 00000100:00100000:0.0:1788836545.483511:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193024 00000100:00100000:0.0:1788836545.483539:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:0.0:1788836545.483545:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770193024:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836545.483569:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770193024:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.483576:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00080000:0.0:1788836545.483594:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836545.483598:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836545.483613:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836545.485288:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770192640 00000100:00100000:3.0:1788836545.485299:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770192640 00000100:00100000:3.0:1788836545.485370:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 341 00000100:00100000:3.0:1788836545.485379:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770192640:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836545.485440:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770192640:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 61us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836545.485447:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 341 00010000:00010000:2.0:1788836545.920274:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836546.022632:0:13669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788836546.302147:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782862464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836546.302226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836546.302318:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862464 00000100:00100000:0.0:1788836546.302326:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862464 00000100:00100000:0.0:1788836546.302367:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788836546.302376:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782862464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836546.302409:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788836546.302452:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782862464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836546.302459:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788836546.302503:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782862464:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1788836546.312382:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788836546.312444:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788836546.312466:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788836546.315039:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315056:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315063:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315070:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836546.315074:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315082:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315101:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff8ade43819000) 00010000:00010000:2.0:1788836546.315104:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836546.315123:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315129:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a65541a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315147:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315154:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315160:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315164:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836546.315167:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315172:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315180:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adf7a535a00) 00010000:00010000:2.0:1788836546.315183:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836546.315186:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315191:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65541b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315208:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315215:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315227:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315233:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836546.315236:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315241:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315259:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff8ade43819000) 00010000:00010000:2.0:1788836546.315262:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836546.315265:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315270:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a655421f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315286:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315292:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315298:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315302:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836546.315305:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315320:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315328:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adf43d52400) 00010000:00010000:2.0:1788836546.315331:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836546.315333:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.315338:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a655423b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836546.315414:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836546.315434:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782862592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788836546.315507:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.315625:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862592 00000100:00100000:2.0:1788836546.315634:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862592 00000100:00100000:2.0:1788836546.316775:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836546.316795:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782862592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788836546.316835:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788836546.316874:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f7abc, atime: 0x6a9f7abc, ctime: 0x6a9f7abc, blocks: 0x0 00010000:00010000:2.0:1788836546.316885:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.316902:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1788836546.316906:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836546.316913:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.316933:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.316956:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.316963:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836546.316982:0:8407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836546.317182:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782862592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 395us (1674us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788836546.317190:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788836546.319591:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788836546.332409:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836546.332426:0:10309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836546.332442:0:10309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836546.332447:0:10309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836546.332479:0:10309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836546.332505:0:10309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836546.332514:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a6554249 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836546.332541:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836546.332543:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836546.332546:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788836546.335042:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adf7fcaaa00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788836546.335058:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782862592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788836546.817569:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836546.817642:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836546.817852:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862720 00000100:00100000:1.0:1788836546.817862:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862720 00000100:00100000:1.0:1788836546.817929:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788836546.817939:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782862720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836546.817976:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836546.818069:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782862720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836546.818077:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788836546.818226:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836546.818996:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782863104:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819111:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782863616:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819137:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819153:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782864128:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819200:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788836546.819206:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782862976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819232:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819263:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782863488:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819284:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819301:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782864000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819322:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836546.819383:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863104 00000100:00100000:2.0:1788836546.819402:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863104 00000100:00100000:2.0:1788836546.819440:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862976 00000100:00100000:2.0:1788836546.819443:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862976 00000100:00100000:2.0:1788836546.819459:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863488 00000100:00100000:2.0:1788836546.819462:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863488 00000100:00100000:2.0:1788836546.819482:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864000 00000100:00100000:2.0:1788836546.819484:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864000 00000100:00100000:2.0:1788836546.819501:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788836546.819508:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819558:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782863104:12345-0@lo:400:kworker.0 Request processed in 49us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819565:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788836546.819582:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788836546.819587:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819615:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782862976:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819622:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788836546.819633:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788836546.819639:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782863488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819671:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782863488:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819677:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788836546.819690:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788836546.819696:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782864000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819724:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782864000:12345-0@lo:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819739:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788836546.819757:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863616 00000100:00100000:2.0:1788836546.819761:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863616 00000100:00100000:2.0:1788836546.819783:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864128 00000100:00100000:2.0:1788836546.819786:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864128 00000100:00100000:2.0:1788836546.819804:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836546.819809:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782863616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819839:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782863616:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819845:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836546.819856:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788836546.819862:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782864128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.819888:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782864128:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.819893:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788836546.819934:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836546.819939:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836546.819969:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782862976:0@lo:400:kworker.0 00010000:00080000:2.0:1788836546.819982:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcaa300 x1875730782863488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836546.819992:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782863488:0@lo:400:kworker.0 00010000:00080000:2.0:1788836546.820001:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca8000 x1875730782864000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836546.820008:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782864000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.820043:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782863104:0@lo:400:kworker.0 00010000:00080000:2.0:1788836546.820063:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca8380 x1875730782863616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836546.820071:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782863616:0@lo:400:kworker.0 00000100:00100000:2.0:1788836546.820081:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782864128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820361:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782863232:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820400:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836546.820472:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782863744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820495:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836546.820526:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788836546.820533:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782862848:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820566:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836546.820588:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782863360:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820609:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836546.820626:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782863872:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836546.820671:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863232 00000100:00100000:3.0:1788836546.820675:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863232 00000100:00100000:3.0:1788836546.820707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788836546.820714:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782863232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820753:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782863232:12345-0@lo:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836546.820760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788836546.820778:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863360 00000100:00100000:3.0:1788836546.820781:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863360 00000100:00100000:3.0:1788836546.820817:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863872 00000100:00100000:3.0:1788836546.820821:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863872 00000100:00100000:3.0:1788836546.820838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788836546.820844:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782863360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820876:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782863360:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836546.820882:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788836546.820893:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788836546.820898:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782863872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.820921:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782863872:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836546.820927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1788836546.820944:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836546.820951:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782863744 00000100:00100000:3.0:1788836546.820954:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782863744 00000100:00100000:3.0:1788836546.820975:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788836546.820980:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782863744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.821048:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782863744:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836546.821055:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788836546.821101:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782863360:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.821111:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782863872:0@lo:400:kworker.0 00000100:00100000:3.0:1788836546.821121:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782863232:0@lo:400:kworker.0 00010000:00080000:3.0:1788836546.821131:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca8a80 x1875730782863744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836546.821152:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782863744:0@lo:400:kworker.0 00000100:00100000:1.0:1788836546.824492:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782862848 00000100:00100000:1.0:1788836546.824513:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782862848 00000100:00100000:1.0:1788836546.824595:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788836546.824607:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782862848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836546.824727:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782862848:12345-0@lo:400:kworker.0 Request processed in 122us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836546.824735:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788836546.824948:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782862848:0@lo:400:kworker.0 00010000:00010000:1.0:1788836546.943260:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836547.331639:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782864256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836547.331715:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.331791:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864256 00000100:00100000:3.0:1788836547.331798:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864256 00000100:00100000:3.0:1788836547.331856:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788836547.331865:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782864256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836547.331892:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836547.331939:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782864256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.331946:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788836547.331988:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782864256:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1788836547.505569:0:13717:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd094cc4e0 20000000:00000080:0.0:1788836547.505587:0:13717:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ade429d2800 uarg=0000000000000000 20000000:01000000:0.0:1788836547.505629:0:13717:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788836547.505635:0:13717:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788836547.505640:0:13717:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788836547.506462:0:13718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788836547.506627:0:13717:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788836547.520461:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788836547.520498:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788836547.520512:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788836547.520530:0:13717:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836547.520551:0:13717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520584:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520593:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520600:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520607:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554100 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520617:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520624:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520631:0:13717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520686:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.520702:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 12 pid: 6485 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836547.520718:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864384:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836547.522682:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836547.522717:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 12 pid: 6484 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.522731:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864512:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836547.522824:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836547.522832:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 23 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.522840:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864640:0@lo:104: 00000100:00100000:1.0:1788836547.522896:0:13717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836547.522932:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836547.522941:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 23 pid: 6485 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.522949:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864768:0@lo:104: 00010000:00010000:1.0:1788836547.522976:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836547.522983:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 23 pid: 6483 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.522990:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864896:0@lo:104: 00010000:00010000:1.0:1788836547.523046:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836547.523060:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 23 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.523068:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782865024:0@lo:104: 00000100:00100000:1.0:1788836547.523089:0:13717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836547.524294:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788836547.524325:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.524358:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.524379:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.524388:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864640 00000100:00100000:3.0:1788836547.524396:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864640 00000100:00100000:3.0:1788836547.524448:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864768 00000100:00100000:3.0:1788836547.524452:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864768 00000100:00100000:3.0:1788836547.524462:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782864896 00000100:00100000:3.0:1788836547.524464:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782864896 00000100:00100000:3.0:1788836547.524472:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865024 00000100:00100000:3.0:1788836547.524474:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865024 00000100:00100000:3.0:1788836547.524486:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836547.524495:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fbec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:13717:x1875730782864640:12345-0@lo:104: 00010000:00010000:3.0:1788836547.524520:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524587:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836547.524593:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fbec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+6:13717:x1875730782864640:12345-0@lo:104: Request processed in 100us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.524599:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836547.524639:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836547.524646:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:13717:x1875730782864768:12345-0@lo:104: 00010000:00010000:3.0:1788836547.524666:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524698:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836547.524703:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+5:13717:x1875730782864768:12345-0@lo:104: Request processed in 59us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.524708:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836547.524721:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836547.524726:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:13717:x1875730782864896:12345-0@lo:104: 00010000:00010000:3.0:1788836547.524733:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524767:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788836547.524772:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+4:13717:x1875730782864896:12345-0@lo:104: Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.524777:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836547.524788:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836547.524793:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:13717:x1875730782865024:12345-0@lo:104: 00010000:00010000:3.0:1788836547.524818:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524842:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788836547.524847:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+3:13717:x1875730782865024:12345-0@lo:104: Request processed in 54us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.524852:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788836547.524876:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788836547.524881:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524899:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836547.524903:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524912:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836547.524919:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836547.524924:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836547.524957:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524964:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836547.524984:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.524990:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43993e00/0xf7b38383a6554100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6554107 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525009:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788836547.525033:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525039:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836547.525042:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525049:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836547.525056:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836547.525061:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836547.525075:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525081:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836547.525095:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525102:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a65540f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525110:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836547.525113:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525129:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836547.525132:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525139:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836547.525145:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836547.525150:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836547.525164:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525170:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836547.525177:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525183:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade438f6600/0xf7b38383a65540e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540eb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525197:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836547.525200:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525206:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836547.525209:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525223:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836547.525239:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836547.525244:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836547.525256:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525261:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836547.525267:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525273:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade438f6000/0xf7b38383a65540d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65540dd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525286:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836547.525288:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836547.525290:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836547.525305:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782865536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.525341:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.525365:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836547.525371:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782865152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.525391:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.525413:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782865280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.525434:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.525452:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836547.525465:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782865408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.525488:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836547.525513:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865536 00000100:00100000:3.0:1788836547.525517:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865536 00010000:00010000:3.0:1788836547.525538:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 24 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.525553:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865152 00000100:00100000:3.0:1788836547.525555:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865152 00010000:00010000:3.0:1788836547.525564:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 25 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.525573:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865280 00000100:00100000:3.0:1788836547.525575:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865280 00010000:00010000:3.0:1788836547.525582:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 26 pid: 6485 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.525590:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865408 00000100:00100000:3.0:1788836547.525592:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865408 00010000:00010000:3.0:1788836547.525601:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 27 pid: 6483 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.525612:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836547.525618:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3614:x1875730782865536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836547.525629:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836547.525634:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 27 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525643:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 27 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525672:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836547.525704:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3614:x1875730782865536:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.525711:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836547.525723:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836547.525729:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3614:x1875730782865152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836547.525735:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836547.525739:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 26 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525747:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 26 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525755:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836547.525775:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3614:x1875730782865152:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.525781:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836547.525792:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836547.525798:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3616:x1875730782865280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836547.525805:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836547.525809:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 25 pid: 6485 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525816:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 25 pid: 6485 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525824:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836547.525856:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3616:x1875730782865280:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.525862:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836547.525874:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836547.525880:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782865408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836547.525887:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836547.525892:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 24 pid: 6483 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525900:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 24 pid: 6483 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.525910:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836547.525933:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782865408:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.525939:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836547.525973:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782865408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.525982:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782865280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.526008:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782865152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836547.526042:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782865536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836547.527532:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836547.527989:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701c00/0xf7b38383a6554107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6554100 expref: 23 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.528005:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864640:0@lo:104: 00010000:00010000:1.0:1788836547.528054:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47c00/0xf7b38383a65540f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65540f2 expref: 22 pid: 6485 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.528063:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864768:0@lo:104: 00010000:00010000:1.0:1788836547.528073:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992a00/0xf7b38383a65540eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65540e4 expref: 21 pid: 6483 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.528080:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864896:0@lo:104: 00010000:00010000:1.0:1788836547.528089:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a65540dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65540d6 expref: 20 pid: 6484 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836547.528095:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782865024:0@lo:104: 00010000:00010000:0.0:1788836547.528740:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836547.536772:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836547.536831:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836547.538454:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193408 00000100:00100000:0.0:1788836547.538467:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193408 00010000:00010000:0.0:1788836547.538515:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 13 pid: 6485 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836547.538551:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193536 00000100:00100000:0.0:1788836547.538555:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193536 00010000:00010000:0.0:1788836547.538571:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 14 pid: 6484 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836547.538597:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788836547.538606:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+14:2395:x1875730770193408:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836547.538621:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836547.538627:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 14 pid: 6485 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538638:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 14 pid: 6485 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538659:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836547.538716:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+14:2395:x1875730770193408:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 111us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836547.538724:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788836547.538741:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1788836547.538747:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770193536:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836547.538754:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836547.538758:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 13 pid: 6484 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538784:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 13 pid: 6484 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538808:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538817:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538832:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538838:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538846:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538853:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538859:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836547.538863:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538871:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538879:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.538896:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836547.538913:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770193536:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 166us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836547.538919:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00010000:00010000:3.0:1788836547.539320:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701800/0xf7b38383a6554115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa235 expref: 12 pid: 6485 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.539335:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864384:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836547.539347:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992400/0xf7b38383a655410e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa22e expref: 11 pid: 6484 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836547.539367:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1875730782864512:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836547.539406:0:13717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.539415:0:13717:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.539422:0:13717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.539428:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f6a00/0xf7b38383a6554250 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836547.975609:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836548.551450:0:13766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9e7b5050 20000000:00000080:0.0:1788836548.551470:0:13766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ade429d2c00 uarg=0000000000000000 20000000:01000000:0.0:1788836548.551525:0:13766:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788836548.551533:0:13766:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788836548.551538:0:13766:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788836548.557528:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788836548.559335:0:13766:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788836548.559649:0:13766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788836548.559687:0:13766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788836548.559704:0:13766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788836548.559719:0:13766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836548.559741:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559758:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559770:0:13766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559778:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559785:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559793:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559817:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836548.559823:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559832:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559846:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559853:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.559859:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f7400/0xf7b38383a6554257 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836548.990186:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836548.990705:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836548.990802:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193664 00000100:00100000:1.0:1788836548.990814:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193664 00000100:00100000:1.0:1788836548.990872:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 343 00000100:00100000:1.0:1788836548.990897:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:6171:x1875730770193664:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836548.990920:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836548.990981:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46000/0xf7b38383a655425e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa282 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836548.991034:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46000/0xf7b38383a655425e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa282 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836548.991046:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46000/0xf7b38383a655425e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa282 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836548.991056:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46000, rc 0) 00000100:00100000:2.0:1788836548.991114:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770193664:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836548.991121:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 343 00000100:00100000:0.0:1788836548.997591:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836548.997706:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193792 00000100:00100000:3.0:1788836548.997722:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193792 00000100:00100000:3.0:1788836548.997808:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 344 00000100:00100000:3.0:1788836548.997823:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770193792:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836548.998092:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770193792:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 272us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836548.998116:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 344 00000100:00100000:1.0:1788836549.010970:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836549.011267:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770193920 00000100:00100000:2.0:1788836549.011280:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770193920 00000100:00100000:2.0:1788836549.011397:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 345 00000100:00100000:2.0:1788836549.011411:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770193920:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.011625:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770193920:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 216us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.011642:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 345 00000100:00100000:0.0:1788836549.026476:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836549.029423:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194048 00000100:00100000:3.0:1788836549.029446:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194048 00000100:00100000:3.0:1788836549.029547:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 346 00000100:00100000:3.0:1788836549.029560:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:10796:x1875730770194048:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836549.029798:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:10796:x1875730770194048:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 239us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.029815:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 346 00000100:00100000:0.0:1788836549.046982:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836549.048825:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194176 00000100:00100000:2.0:1788836549.048867:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194176 00000100:00100000:2.0:1788836549.048956:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 347 00000100:00100000:2.0:1788836549.048969:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:10796:x1875730770194176:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836549.049245:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:10796:x1875730770194176:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 278us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.049254:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 347 00000100:00100000:0.0:1788836549.084655:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836549.088166:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194304 00000100:00100000:1.0:1788836549.088189:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194304 00000100:00100000:2.0:1788836549.088456:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 348 00000100:00100000:2.0:1788836549.088471:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:6171:x1875730770194304:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.088495:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836549.088521:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa289 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.088559:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa289 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.088572:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa289 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.088583:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46400, rc 0) 00000100:00100000:2.0:1788836549.088690:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770194304:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 223us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.088698:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 348 00000100:00100000:0.0:1788836549.098435:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836549.098608:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194432 00000100:00100000:3.0:1788836549.098622:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194432 00000100:00100000:3.0:1788836549.098710:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 349 00000100:00100000:3.0:1788836549.098721:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770194432:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836549.098924:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770194432:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 204us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.098932:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 349 00000100:00100000:0.0:1788836549.111991:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836549.112513:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194560 00000100:00100000:1.0:1788836549.112527:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194560 00000100:00100000:1.0:1788836549.112607:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 350 00000100:00100000:1.0:1788836549.112621:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770194560:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.112838:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:6171:x1875730770194560:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 220us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.112847:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 350 00000100:00100000:0.0:1788836549.140737:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836549.141510:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194688 00000100:00100000:2.0:1788836549.141526:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194688 00000100:00100000:2.0:1788836549.141613:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 351 00000100:00100000:2.0:1788836549.141626:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:10800:x1875730770194688:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836549.141845:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:10800:x1875730770194688:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 221us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.141854:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 351 00000100:00100000:0.0:1788836549.155373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836549.155525:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194816 00000100:00100000:3.0:1788836549.155540:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194816 00000100:00100000:3.0:1788836549.155618:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 352 00000100:00100000:3.0:1788836549.155638:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:10800:x1875730770194816:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836549.155863:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:10800:x1875730770194816:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 227us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.155871:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 352 10000000:01000000:1.0:1788836549.310470:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836549.310482:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7fbb1000 from 7 10000000:01000000:1.0:1788836549.310487:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836549.310557:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836549.310571:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836549.310584:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836549.310622:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.314480:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.314667:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.315869:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865664 00000100:00100000:2.0:1788836549.315887:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865664 00000100:00100000:2.0:1788836549.315972:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788836549.315985:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:6487:x1875730782865664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.316009:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836549.318319:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6554273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655426c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.318369:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6554273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655426c expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.318384:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6554273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655426c expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.318395:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46a00, rc 0) 00000100:00100000:2.0:1788836549.318528:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782865664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2544us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.318538:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788836549.319059:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836549.319398:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836549.319412:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836549.319533:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.319585:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.319644:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.319846:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865792 00000100:00100000:2.0:1788836549.319855:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865792 00000100:00100000:2.0:1788836549.319913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788836549.319924:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782865792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.320508:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782865792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 581us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.320533:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788836549.324951:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.327812:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.327962:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.328285:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.335583:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782865920 00000100:00100000:2.0:1788836549.335605:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782865920 00000100:00100000:2.0:1788836549.335845:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788836549.335861:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782865920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.336182:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782865920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (8219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.336207:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788836549.336387:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782865920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836549.337208:0:13779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13779:1875730782866048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836549.337304:0:13779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.337367:0:13779:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836549.337605:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866048 00000100:00100000:3.0:1788836549.337615:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866048 00000100:00100000:3.0:1788836549.337672:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788836549.337682:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:13779:x1875730782866048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836549.337849:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:13779:x1875730782866048:12345-0@lo:502:llog_process_th.0 Request processed in 168us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.337857:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788836549.338564:0:13779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13779:1875730782866048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836549.338608:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836549.338622:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836549.338624:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836549.338633:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf7fbb1000 00000020:00000080:1.0:1788836549.338636:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836549.338815:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836549.341411:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836549.341420:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836549.341437:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836549.341445:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836549.341447:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788836549.341453:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf7fbb1000 00000020:00000080:2.0:1788836549.341457:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836549.341591:0:13779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13779:1875730782866176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836549.342822:0:13779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.342954:0:13779:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836549.349572:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866176 00000100:00100000:3.0:1788836549.349594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866176 00000100:00100000:3.0:1788836549.350077:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788836549.350097:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:13779:x1875730782866176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836549.350361:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:13779:x1875730782866176:12345-0@lo:502:llog_process_th.0 Request processed in 265us (7544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.350371:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788836549.350929:0:13779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13779:1875730782866176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836549.350982:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836549.350996:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836549.350999:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788836549.351005:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788836549.351212:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788836549.351334:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836549.351351:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.351365:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.351379:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836549.351382:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf7a54e000 from 7 10000000:01000000:2.0:1788836549.351392:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836549.351435:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.351444:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.351455:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836549.351481:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.351542:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.351587:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4133a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.351623:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866304 00000100:00100000:2.0:1788836549.351631:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866304 00000100:00100000:2.0:1788836549.351672:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788836549.351681:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:6487:x1875730782866304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.352755:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836549.352785:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6554281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655427a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.352829:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6554281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655427a expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.352842:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6554281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655427a expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.352854:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46e00, rc 0) 00000100:00100000:2.0:1788836549.352948:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782866304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1265us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.352976:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788836549.353076:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.353098:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.353109:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836549.355492:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.355583:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.355656:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.355699:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866432 00000100:00100000:1.0:1788836549.355715:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866432 00000100:00100000:1.0:1788836549.355800:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788836549.355811:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782866432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.356054:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782866432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.356062:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788836549.357598:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.359729:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.359871:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.359939:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.359964:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866560 00000100:00100000:1.0:1788836549.359978:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866560 00000100:00100000:1.0:1788836549.360070:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788836549.360081:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782866560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.360297:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782866560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.360305:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788836549.360476:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782866560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836549.361461:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13782:1875730782866688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836549.361518:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.361556:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4133a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.362391:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866688 00000100:00100000:2.0:1788836549.362406:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866688 00000100:00100000:2.0:1788836549.362469:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788836549.362480:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:13782:x1875730782866688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836549.362663:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:13782:x1875730782866688:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.362672:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788836549.366191:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13782:1875730782866688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836549.366283:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836549.366303:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836549.366306:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836549.366314:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf7a54e000 00000020:00000080:3.0:1788836549.366318:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836549.366402:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836549.366406:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836549.366407:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836549.366410:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836549.366413:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836549.366414:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788836549.366418:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf7a54e000 00000020:00000080:3.0:1788836549.366421:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788836549.366486:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13782:1875730782866816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836549.366593:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.366662:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.366671:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866816 00000100:00100000:1.0:1788836549.366688:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866816 00000100:00100000:1.0:1788836549.367916:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788836549.367938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:13782:x1875730782866816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836549.369586:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:13782:x1875730782866816:12345-0@lo:502:llog_process_th.0 Request processed in 1649us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.369599:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788836549.369863:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13782:1875730782866816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836549.369916:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836549.369926:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836549.370874:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788836549.370884:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788836549.374431:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788836549.374507:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836549.374523:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836549.374541:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782866944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788836549.374549:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.374566:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836549.374569:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf444f2000 from 7 10000000:01000000:2.0:1788836549.374572:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836549.374618:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836549.374630:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836549.374642:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.374657:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836549.374684:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.374697:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782866944 00000100:00100000:1.0:1788836549.374706:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782866944 00000100:00100000:2.0:1788836549.374757:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.374773:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788836549.374803:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42589240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.375009:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867072 00000100:00100000:2.0:1788836549.375031:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867072 00000100:00100000:2.0:1788836549.375064:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788836549.375074:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:6487:x1875730782867072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.375089:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836549.375106:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47c00/0xf7b38383a655428f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6554288 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.375136:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47c00/0xf7b38383a655428f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6554288 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.375166:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47c00/0xf7b38383a655428f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554288 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.375176:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47c00, rc 0) 00000100:00100000:2.0:1788836549.375237:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.375244:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788836549.375294:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836549.375313:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.375323:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836549.375464:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.375498:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.375516:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42589240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.375639:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782866944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836549.375679:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836549.375717:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782866944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.375798:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782866944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836549.381391:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867200 00000100:00100000:0.0:1788836549.381412:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867200 00000100:00100000:0.0:1788836549.381512:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788836549.381527:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836549.381980:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.381990:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788836549.382051:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.382117:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.382207:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.382680:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42589240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836549.382766:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867328 00000100:00100000:0.0:1788836549.382774:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867328 00000100:00100000:0.0:1788836549.382801:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788836549.382809:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836549.383042:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788836549.383219:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 409us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.383229:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788836549.383732:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836549.386724:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13784:1875730782867456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836549.386861:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.386923:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.387562:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867456 00000100:00100000:1.0:1788836549.387575:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867456 00000100:00100000:1.0:1788836549.387639:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788836549.387653:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:13784:x1875730782867456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836549.387887:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:13784:x1875730782867456:12345-0@lo:502:llog_process_th.0 Request processed in 237us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.387897:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788836549.387952:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13784:1875730782867456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836549.388009:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836549.388072:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.388076:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836549.388092:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf444f2000 00000020:00000080:0.0:1788836549.388097:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836549.388211:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836549.388216:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.388217:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836549.388220:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836549.388233:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.388235:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788836549.388240:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf444f2000 00000020:00000080:0.0:1788836549.388243:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836549.388421:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13784:1875730782867584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836549.388489:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.388542:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836549.389052:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867584 00000100:00100000:1.0:1788836549.389062:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867584 00000100:00100000:1.0:1788836549.389108:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788836549.389116:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:13784:x1875730782867584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836549.389250:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:13784:x1875730782867584:12345-0@lo:502:llog_process_th.0 Request processed in 134us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.389258:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788836549.392718:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13784:1875730782867584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836549.392784:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836549.392799:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.392802:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788836549.392811:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:0.0:1788836549.395549:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1788836549.398238:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788836549.401324:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836549.401348:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.401363:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.401378:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836549.401382:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf50b59800 from 7 10000000:01000000:2.0:1788836549.401385:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836549.401442:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.401451:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.401464:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836549.401497:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.401609:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.401676:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836549.401843:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867712 00000100:00100000:0.0:1788836549.401855:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867712 00000100:00100000:0.0:1788836549.401928:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788836549.401940:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:6487:x1875730782867712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836549.401958:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836549.401976:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade438f6600/0xf7b38383a655429d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6554296 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.402007:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade438f6600/0xf7b38383a655429d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6554296 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.404254:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade438f6600/0xf7b38383a655429d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6554296 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.404510:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6600, rc 0) 00000100:00100000:0.0:1788836549.404705:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782867712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2764us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.404735:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788836549.405917:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836549.405951:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836549.405965:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836549.406073:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.406254:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.406335:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836549.409597:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867840 00000100:00100000:3.0:1788836549.409613:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867840 00000100:00100000:3.0:1788836549.409678:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788836549.409692:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782867840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836549.409894:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782867840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.409901:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788836549.410354:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836549.410438:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836549.410525:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.410590:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836549.410874:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782867968 00000100:00100000:2.0:1788836549.410882:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782867968 00000100:00100000:2.0:1788836549.410943:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788836549.410954:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782867968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836549.411432:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:6487:x1875730782867968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 477us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.411453:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788836549.411520:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:6487:1875730782867968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836549.414661:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13785:1875730782868096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836549.414751:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.415515:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf413770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836549.415681:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868096 00000100:00100000:0.0:1788836549.415691:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868096 00000100:00100000:0.0:1788836549.415751:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788836549.415772:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:13785:x1875730782868096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836549.419960:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:13785:x1875730782868096:12345-0@lo:502:llog_process_th.0 Request processed in 4173us (5192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.419980:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788836549.420257:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13785:1875730782868096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836549.420328:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836549.420340:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.420343:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836549.420362:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf50b59800 00000020:00000080:0.0:1788836549.420366:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836549.420448:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836549.420453:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.420454:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836549.420457:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836549.420460:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.420462:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788836549.420467:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf50b59800 00000020:00000080:0.0:1788836549.420469:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836549.420536:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13785:1875730782868224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836549.420620:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.420663:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868224 00000100:00100000:0.0:1788836549.420677:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868224 00000100:00100000:0.0:1788836549.420735:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788836549.420745:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:13785:x1875730782868224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836549.420894:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:13785:x1875730782868224:12345-0@lo:502:llog_process_th.0 Request processed in 149us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.420903:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788836549.420969:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496add80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836549.420987:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:13785:1875730782868224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836549.421046:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836549.421052:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836549.421054:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788836549.421059:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788836549.421165:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788836549.421233:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836549.421249:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.421263:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836549.451761:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836550.015912:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836550.398793:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836550.400738:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782868352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836550.401167:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836550.401490:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868352 00000100:00100000:3.0:1788836550.401498:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868352 00000100:00100000:3.0:1788836550.401559:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788836550.401569:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782868352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836550.401613:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836550.401655:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782868352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836550.401663:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788836550.401683:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836550.401715:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b69f80 x1875730782868352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836550.401734:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782868352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836550.401748:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836550.401754:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782868480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836550.401794:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836550.402468:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868480 00000100:00100000:3.0:1788836550.402475:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868480 00000100:00100000:3.0:1788836550.402529:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788836550.402536:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782868480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836550.402551:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836550.402590:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782868480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836550.402597:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788836550.402614:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836550.402636:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b6bb80 x1875730782868480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836550.402650:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782868480:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788836550.462940:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788836550.600857:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836550.602527:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770194944 00000100:00100000:2.0:1788836550.602548:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770194944 00000100:00100000:2.0:1788836550.602647:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 373 00000100:00100000:2.0:1788836550.602659:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770194944:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836550.602772:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770194944:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 114us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836550.602781:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 373 00000100:00100000:0.0:1788836550.603626:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836550.603716:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195200 00000100:00100000:2.0:1788836550.603727:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195200 00000100:00100000:2.0:1788836550.603804:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:2.0:1788836550.603817:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195200:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836550.603922:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195200:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836550.603931:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00080000:3.0:1788836550.605600:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836550.612241:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836550.612376:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836550.615544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836550.615582:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836550.615715:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195328 00000100:00100000:1.0:1788836550.615727:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195328 00000100:00100000:1.0:1788836550.615798:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:1.0:1788836550.615810:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195328:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836550.615897:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195328:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836550.615904:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00080000:1.0:1788836550.616107:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836550.621364:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195456 00000100:00100000:3.0:1788836550.621393:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195456 00000100:00100000:3.0:1788836550.621492:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195072 00000100:00100000:3.0:1788836550.621496:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195072 00000100:00100000:3.0:1788836550.621528:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:3.0:1788836550.621539:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770195456:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836550.621622:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770195456:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (10173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836550.621630:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:3.0:1788836550.621770:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:3.0:1788836550.621780:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195072:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836550.621809:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770195072:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (9433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836550.621815:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00080000:1.0:1788836550.621922:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836550.622341:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195584 00000100:00100000:3.0:1788836550.622347:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195584 00000100:00100000:3.0:1788836550.622396:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:3.0:1788836550.622404:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770195584:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836550.622445:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770195584:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (6862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836550.622452:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00080000:1.0:1788836550.622647:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788836551.040868:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836551.423327:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836551.423352:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782868608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836551.423442:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.423551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868608 00000100:00100000:2.0:1788836551.423559:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868608 00000100:00100000:2.0:1788836551.423608:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788836551.423618:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782868608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836551.425349:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836551.425457:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782868608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1837us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.425467:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788836551.425635:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782868608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836551.934412:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836551.934438:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782868736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836551.934534:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836551.934718:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868736 00000100:00100000:1.0:1788836551.934727:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868736 00000100:00100000:1.0:1788836551.934793:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788836551.934804:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782868736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836551.934835:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836551.934882:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782868736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836551.934890:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788836551.934952:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836551.934989:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782868736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836551.937001:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782868992:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937093:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937142:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782869504:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937177:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782870016:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937227:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937267:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788836551.937273:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782868864:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937301:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937321:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782869376:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937368:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782869888:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937389:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836551.937421:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868992 00000100:00100000:2.0:1788836551.937428:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868992 00000100:00100000:2.0:1788836551.937469:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869504 00000100:00100000:2.0:1788836551.937472:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869504 00000100:00100000:2.0:1788836551.937495:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870016 00000100:00100000:2.0:1788836551.937498:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870016 00000100:00100000:2.0:1788836551.937509:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869376 00000100:00100000:2.0:1788836551.937512:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869376 00000100:00100000:2.0:1788836551.937523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869888 00000100:00100000:2.0:1788836551.937525:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869888 00000100:00100000:2.0:1788836551.937540:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788836551.937547:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782868992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937606:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782868992:12345-0@lo:400:kworker.0 Request processed in 50us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.937614:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788836551.937630:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788836551.937637:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782869504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937667:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782869504:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.937673:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788836551.937684:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788836551.937690:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782870016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937712:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782870016:12345-0@lo:400:kworker.0 Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.937717:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788836551.937726:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788836551.937739:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782869376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937764:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782869376:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.937768:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788836551.937779:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788836551.937783:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782869888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937802:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782869888:12345-0@lo:400:kworker.0 Request processed in 18us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836551.937806:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788836551.937828:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836551.937832:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836551.937857:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782869376:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782869888:0@lo:400:kworker.0 00000100:00100000:2.0:1788836551.937874:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782868992:0@lo:400:kworker.0 00010000:00080000:2.0:1788836551.937883:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43893480 x1875730782869504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836551.937892:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782869504:0@lo:400:kworker.0 00010000:00080000:2.0:1788836551.937898:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a5500 x1875730782870016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836551.937905:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782870016:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938104:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782868864 00000100:00100000:0.0:1788836551.938109:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782868864 00000100:00100000:0.0:1788836551.938144:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788836551.938150:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782868864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938208:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf72c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782868864:12345-0@lo:400:kworker.0 Request processed in 58us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836551.938220:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788836551.938249:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782869120:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938274:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836551.938291:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782869632:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938314:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836551.938328:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870144:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938345:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836551.938359:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788836551.938364:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782869248:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938384:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836551.938399:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782869760:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938414:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836551.938439:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869120 00000100:00100000:0.0:1788836551.938442:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869120 00000100:00100000:0.0:1788836551.938463:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788836551.938469:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782869120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938501:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782869120:12345-0@lo:400:kworker.0 Request processed in 32us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836551.938506:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788836551.938532:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782869120:0@lo:400:kworker.0 00000100:00100000:0.0:1788836551.938551:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782868864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.938713:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869248 00000100:00100000:1.0:1788836551.938718:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869248 00000100:00100000:1.0:1788836551.938757:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836551.938764:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.938815:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782869248:12345-0@lo:400:kworker.0 Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836551.938821:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836551.938845:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869632 00000100:00100000:1.0:1788836551.938849:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869632 00000100:00100000:1.0:1788836551.938870:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870144 00000100:00100000:1.0:1788836551.938873:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870144 00000100:00100000:1.0:1788836551.938893:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782869760 00000100:00100000:1.0:1788836551.938895:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782869760 00000100:00100000:1.0:1788836551.938908:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836551.938915:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.938946:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782869632:12345-0@lo:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836551.938952:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836551.938975:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788836551.938981:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.939039:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870144:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836551.939044:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788836551.939057:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788836551.939062:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782869760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.939091:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782869760:12345-0@lo:400:kworker.0 Request processed in 28us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836551.939096:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788836551.939114:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836551.939132:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782869248:0@lo:400:kworker.0 00010000:00080000:1.0:1788836551.939142:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf444a4380 x1875730782869760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836551.939150:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782869760:0@lo:400:kworker.0 00010000:00080000:1.0:1788836551.939173:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43893100 x1875730782869632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836551.939180:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782869632:0@lo:400:kworker.0 00000100:00100000:1.0:1788836551.939190:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870144:0@lo:400:kworker.0 00000001:00080000:0.0:1788836551.944549:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788836552.062232:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836552.446336:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836552.452174:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836552.452255:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836552.466456:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870272 00000100:00100000:0.0:1788836552.466488:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870272 00000100:00100000:0.0:1788836552.466561:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788836552.466572:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836552.466601:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836552.466692:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (14435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836552.466700:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836552.466907:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788836553.086459:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836554.110352:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836554.494322:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836554.494385:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782870400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836554.494475:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836554.494538:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870400 00000100:00100000:2.0:1788836554.494547:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870400 00000100:00100000:2.0:1788836554.494609:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788836554.494617:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782870400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836554.494694:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836554.494757:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782870400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836554.494765:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788836554.494965:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782870400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788836555.134217:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836555.518243:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836555.518265:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836555.518353:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836555.518454:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870528 00000100:00100000:2.0:1788836555.518463:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870528 00000100:00100000:2.0:1788836555.518529:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788836555.518539:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782870528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836555.518566:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836555.518610:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782870528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836555.518618:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836555.518901:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836555.518910:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782870656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836555.518941:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836555.518969:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870656 00000100:00100000:0.0:1788836555.518972:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870656 00000100:00100000:0.0:1788836555.518993:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836555.518997:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782870656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836555.519006:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836555.519043:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782870656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836555.519048:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788836555.519081:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920e00 x1875730782870656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836555.519112:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782870656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836555.526220:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836555.526285:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463dad80 x1875730782870528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836555.526311:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836555.712271:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712318:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712344:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712379:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712399:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712495:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836555.712542:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196096 00000100:00100000:1.0:1788836555.712551:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196096 00000100:00100000:1.0:1788836555.712612:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:1.0:1788836555.712622:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770196096:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836555.712690:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770196096:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836555.712698:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:2.0:1788836555.712922:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195968 00000100:00100000:2.0:1788836555.712927:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195968 00000100:00100000:2.0:1788836555.712968:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196224 00000100:00100000:2.0:1788836555.712971:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196224 00000100:00100000:2.0:1788836555.712987:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195840 00000100:00100000:2.0:1788836555.712990:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195840 00000100:00100000:2.0:1788836555.713001:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196352 00000100:00100000:2.0:1788836555.713003:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196352 00000100:00100000:2.0:1788836555.713036:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 247 00000100:00100000:2.0:1788836555.713044:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770195968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836555.713075:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770195968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836555.713081:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 247 00000100:00100000:2.0:1788836555.713107:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:2.0:1788836555.713113:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770196224:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836555.713147:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770196224:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836555.713154:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:2.0:1788836555.713169:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 249 00000100:00100000:2.0:1788836555.713175:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770195840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836555.713199:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770195840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836555.713204:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 249 00000100:00100000:2.0:1788836555.713216:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:2.0:1788836555.713222:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770196352:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836555.713245:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770196352:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836555.713251:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:3.0:1788836555.713799:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770195712 00000100:00100000:3.0:1788836555.713804:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770195712 00000100:00100000:3.0:1788836555.713848:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 375 00000100:00100000:3.0:1788836555.713856:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770195712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836555.713886:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770195712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836555.713893:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 375 00000100:00080000:3.0:1788836555.713920:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836555.713925:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836555.713928:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788836556.158156:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836556.542448:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836556.542473:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836556.542556:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836556.542795:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870784 00000100:00100000:2.0:1788836556.542804:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870784 00000100:00100000:2.0:1788836556.542859:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788836556.542869:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836556.542904:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836556.542950:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782870784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836556.542957:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788836556.543091:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782870784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836557.055178:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782871040:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.055262:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.055327:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782871552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.055365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.055389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782872064:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.055862:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.055899:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788836557.055906:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782870912:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.055938:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.055958:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782871424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.055980:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.055997:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782871936:0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.056038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836557.056080:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871040 00000100:00100000:0.0:1788836557.056088:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871040 00000100:00100000:0.0:1788836557.056132:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871552 00000100:00100000:0.0:1788836557.056136:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871552 00000100:00100000:0.0:1788836557.056160:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872064 00000100:00100000:0.0:1788836557.056162:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872064 00000100:00100000:0.0:1788836557.056176:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871424 00000100:00100000:0.0:1788836557.056178:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871424 00000100:00100000:0.0:1788836557.056187:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871936 00000100:00100000:1.0:1788836557.056332:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788836557.056343:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782871040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056413:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782871040:12345-0@lo:400:kworker.0 Request processed in 71us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.056421:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788836557.056442:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788836557.056449:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782871552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056518:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782871552:12345-0@lo:400:kworker.0 Request processed in 69us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.056525:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788836557.056540:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788836557.056546:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782872064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056574:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782872064:12345-0@lo:400:kworker.0 Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.056580:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788836557.056592:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788836557.056598:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782871424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056636:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782871424:12345-0@lo:400:kworker.0 Request processed in 36us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.056642:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788836557.056690:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782871296:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056721:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.056740:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782871808:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.056763:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.056781:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782872320:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.057083:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.057110:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788836557.057117:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782871168:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.057140:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.057155:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782871680:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.057173:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.057188:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782872192:0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.057379:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782870912 00000100:00100000:2.0:1788836557.057385:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782870912 00000100:00100000:2.0:1788836557.057424:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788836557.057431:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782870912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.057492:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782870912:12345-0@lo:400:kworker.0 Request processed in 61us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836557.057499:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788836557.057531:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871296 00000100:00100000:2.0:1788836557.057535:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871296 00000100:00100000:2.0:1788836557.057559:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788836557.057565:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782871296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.057599:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782871296:12345-0@lo:400:kworker.0 Request processed in 35us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836557.057604:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788836557.057629:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782872448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836557.057669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836557.057719:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836557.057724:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836557.057743:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871808 00000100:00100000:2.0:1788836557.057747:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871808 00000100:00100000:2.0:1788836557.057774:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872320 00000100:00100000:2.0:1788836557.057777:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872320 00000100:00100000:0.0:1788836557.058027:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871936 00000100:00100000:0.0:1788836557.058057:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871168 00000100:00100000:0.0:1788836557.058059:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871168 00000100:00100000:0.0:1788836557.058092:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788836557.058098:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782871936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.058140:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782871936:12345-0@lo:400:kworker.0 Request processed in 43us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836557.058147:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788836557.058161:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788836557.058167:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782871168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836557.058241:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782871168:12345-0@lo:400:kworker.0 Request processed in 73us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836557.058246:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788836557.058267:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872448 00000100:00100000:0.0:1788836557.058271:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872448 00000100:00100000:0.0:1788836557.058293:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788836557.058299:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782872448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836557.058320:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836557.058606:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782871680 00000100:00100000:2.0:1788836557.058611:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782871680 00000100:00100000:2.0:1788836557.058632:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836557.058640:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782871808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.058675:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782871808:12345-0@lo:400:kworker.0 Request processed in 37us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836557.058682:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836557.058694:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836557.058700:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782872320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.058737:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782872320:12345-0@lo:400:kworker.0 Request processed in 38us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836557.058743:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836557.058753:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836557.058760:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782871680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.058786:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782871680:12345-0@lo:400:kworker.0 Request processed in 27us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.058864:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.058895:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782871296:0@lo:400:kworker.0 00010000:00080000:1.0:1788836557.058909:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920380 x1875730782871808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836557.058919:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782871808:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.058929:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788836557.058934:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adf7fcaaa00, transno 4294967301 00000100:00100000:1.0:1788836557.058946:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782872320:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.058988:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782871168:0@lo:400:kworker.0 00010000:00080000:1.0:1788836557.058998:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920a80 x1875730782871680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836557.059006:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782871680:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059053:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872192 00000100:00100000:1.0:1788836557.059056:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872192 00000100:00100000:1.0:1788836557.059090:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788836557.059097:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782872192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059132:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782872192:12345-0@lo:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.059138:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788836557.059272:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782872192:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059311:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782870912:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059324:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782871424:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059335:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782871936:0@lo:400:kworker.0 00000100:00100000:1.0:1788836557.059363:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782871040:0@lo:400:kworker.0 00010000:00080000:1.0:1788836557.059377:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43923100 x1875730782871552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836557.059387:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782871552:0@lo:400:kworker.0 00010000:00080000:1.0:1788836557.059398:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77369500 x1875730782872064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836557.059407:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782872064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836557.059705:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788836557.059974:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782872448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1673us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836557.059982:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836557.060274:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782872448:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788836557.061038:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836557.061046:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836557.061049:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788836557.182341:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836557.568209:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836557.568234:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782872576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836557.568315:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836557.568655:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872576 00000100:00100000:1.0:1788836557.568663:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872576 00000100:00100000:1.0:1788836557.568719:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788836557.568729:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782872576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836557.568754:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836557.568817:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782872576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836557.568825:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836557.569428:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782872576:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788836558.212557:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836559.231234:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836559.614471:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782872704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836559.614547:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836559.628064:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872704 00000100:00100000:3.0:1788836559.628080:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872704 00000100:00100000:3.0:1788836559.629247:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788836559.629263:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782872704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836559.629300:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836559.629394:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782872704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (14847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836559.629401:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788836559.629492:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782872704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836560.254965:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836560.638204:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836560.638227:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782872832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836560.638228:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782872960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836560.638299:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836560.638339:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836560.638388:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872832 00000100:00100000:0.0:1788836560.638396:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872832 00000100:00100000:0.0:1788836560.638451:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782872960 00000100:00100000:0.0:1788836560.638455:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782872960 00000100:00100000:0.0:1788836560.638474:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788836560.638482:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782872832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836560.638513:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836560.638574:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782872832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.638583:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788836560.638603:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1788836560.638613:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43b18700 x1875730782872832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836560.638613:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782872960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836560.638629:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836560.638639:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782872832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836560.638665:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782872960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.638673:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788836560.638701:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77369500 x1875730782872960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836560.638714:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782872960:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788836560.638876:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788836560.639206:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788836560.703455:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836560.847589:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836560.847642:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836560.847721:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836560.847818:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196480 00000100:00100000:0.0:1788836560.847829:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196480 00000100:00100000:0.0:1788836560.847898:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 377 00000100:00100000:0.0:1788836560.847909:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770196480:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836560.847978:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf4553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770196480:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.847986:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 377 00000100:00100000:0.0:1788836560.848081:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196608 00000100:00100000:0.0:1788836560.848085:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196608 00000100:00100000:0.0:1788836560.848119:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196736 00000100:00100000:0.0:1788836560.848123:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196736 00000100:00100000:0.0:1788836560.848142:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:0.0:1788836560.848149:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770196608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836560.848181:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770196608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.848200:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:0.0:1788836560.848214:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:0.0:1788836560.848220:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770196736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836560.848248:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770196736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.848254:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00080000:1.0:1788836560.848874:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836560.848879:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836560.869848:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836560.869890:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836560.869961:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196992 00000100:00100000:2.0:1788836560.869971:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196992 00000100:00100000:0.0:1788836560.869988:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836560.870083:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197120 00000100:00100000:2.0:1788836560.870087:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197120 00000100:00100000:0.0:1788836560.870092:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:0.0:1788836560.870108:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770196992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836560.870111:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 260 00000100:00100000:2.0:1788836560.870123:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770197120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836560.870206:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770197120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836560.870211:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 260 00000100:00080000:3.0:1788836560.870233:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836560.870239:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836560.870296:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770196864 00000100:00100000:1.0:1788836560.870301:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770196864 00000100:00080000:2.0:1788836560.870337:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836560.870350:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:1.0:1788836560.870360:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2393:x1875730770196864:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788836560.870380:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65541c4 00000100:00080000:1.0:1788836560.870390:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788836560.870420:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788836560.870439:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788836560.876903:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770196992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 6786us (6998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836560.876921:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:1.0:1788836560.884780:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+2:2393:x1875730770196864:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 14409us (14929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836560.884796:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00010000:00010000:0.0:1788836561.278167:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836561.663276:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836561.663300:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782873088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836561.663376:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836561.663549:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873088 00000100:00100000:2.0:1788836561.663558:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873088 00000100:00100000:2.0:1788836561.663609:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788836561.663618:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782873088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836561.663655:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836561.663701:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782873088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836561.663707:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836561.664275:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782873088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836562.174763:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782873600:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.174851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.174924:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782874112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.174952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.175006:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782874624:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175057:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.175087:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788836562.175093:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782873472:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.175136:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782873984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175157:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.175175:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782874496:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175195:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.175225:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874112 00000100:00100000:1.0:1788836562.175233:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874112 00000100:00100000:1.0:1788836562.175280:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874624 00000100:00100000:1.0:1788836562.175283:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874624 00000100:00100000:1.0:1788836562.175305:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836562.175314:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782874112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175367:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782874112:12345-0@lo:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836562.175374:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836562.175395:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836562.175401:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782874624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175429:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782874624:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836562.175435:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836562.175471:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873600 00000100:00100000:1.0:1788836562.175475:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873600 00000100:00100000:1.0:1788836562.175499:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873984 00000100:00100000:1.0:1788836562.175501:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873984 00000100:00100000:1.0:1788836562.175515:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874496 00000100:00100000:1.0:1788836562.175517:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874496 00000100:00100000:1.0:1788836562.175536:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788836562.175542:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782873600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175573:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782873600:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836562.175580:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788836562.175593:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788836562.175599:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782873984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175624:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782873984:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836562.175630:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788836562.175641:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788836562.175646:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782874496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175669:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782874496:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836562.175674:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00080000:1.0:1788836562.175715:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920a80 x1875730782873984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836562.175727:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782873984:0@lo:400:kworker.0 00010000:00080000:1.0:1788836562.175738:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436f9180 x1875730782874496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836562.175756:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782874496:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175768:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782873600:0@lo:400:kworker.0 00010000:00080000:1.0:1788836562.175776:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43923800 x1875730782874112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836562.175784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782874112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836562.175792:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782874624:0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.175893:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873472 00000100:00100000:3.0:1788836562.175897:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873472 00000100:00100000:3.0:1788836562.175935:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788836562.175941:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782873472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.175998:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782873472:12345-0@lo:400:kworker.0 Request processed in 56us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.176034:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788836562.176061:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782873472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176348:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782873216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176382:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176413:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782873728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176435:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176451:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874240:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176472:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176490:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874752:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176508:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176525:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788836562.176531:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782873344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176550:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176566:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782873856:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176584:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176597:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782874368:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176617:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836562.176646:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874240 00000100:00100000:2.0:1788836562.176649:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874240 00000100:00100000:2.0:1788836562.176669:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874752 00000100:00100000:2.0:1788836562.176672:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874752 00000100:00100000:2.0:1788836562.176687:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788836562.176692:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176722:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874240:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836562.176727:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788836562.176738:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788836562.176744:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176765:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874752:12345-0@lo:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836562.176770:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788836562.176784:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873344 00000100:00100000:2.0:1788836562.176787:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873344 00000100:00100000:2.0:1788836562.176801:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873856 00000100:00100000:2.0:1788836562.176803:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873856 00000100:00100000:2.0:1788836562.176814:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874368 00000100:00100000:2.0:1788836562.176816:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874368 00000100:00100000:2.0:1788836562.176828:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788836562.176834:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782873344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.176862:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782873344:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836562.176867:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788836562.176971:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873216 00000100:00100000:3.0:1788836562.176985:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873216 00000100:00100000:3.0:1788836562.177027:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788836562.177034:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782873216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177065:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782873216:12345-0@lo:400:kworker.0 Request processed in 33us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.177071:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788836562.177116:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788836562.177123:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782873856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177152:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782873856:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.177157:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788836562.177171:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788836562.177177:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782874368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177201:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782874368:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.177206:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788836562.177227:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836562.177231:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836562.177234:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836562.177236:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836562.177281:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782873344:0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177291:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782873856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177309:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782874368:0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177316:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782873216:0@lo:400:kworker.0 00010000:00080000:3.0:1788836562.177326:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43920380 x1875730782874240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836562.177335:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874240:0@lo:400:kworker.0 00000100:00100000:3.0:1788836562.177342:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874752:0@lo:400:kworker.0 00000100:00100000:0.0:1788836562.177681:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782873728 00000100:00100000:0.0:1788836562.177686:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782873728 00000100:00100000:0.0:1788836562.177724:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836562.177741:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782873728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836562.177789:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782873728:12345-0@lo:400:kworker.0 Request processed in 49us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836562.177803:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788836562.178341:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782873728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836562.178357:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836562.178364:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836562.178406:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836562.178485:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782874880 00000100:00100000:3.0:1788836562.178490:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782874880 00000100:00100000:3.0:1788836562.178537:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788836562.178545:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836562.178568:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836562.178784:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782874880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 240us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.178791:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788836562.180263:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782874880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836562.302427:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836562.686655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782875008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836562.686737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836562.688409:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875008 00000100:00100000:1.0:1788836562.688425:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875008 00000100:00100000:1.0:1788836562.688628:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788836562.688641:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782875008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836562.688669:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836562.688753:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782875008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836562.688835:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782875008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836562.689008:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:2.0:1788836563.326773:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836564.350168:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836564.735881:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782875136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836564.735968:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836564.736172:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875136 00000100:00100000:1.0:1788836564.736180:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875136 00000100:00100000:1.0:1788836564.736231:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788836564.736240:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782875136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836564.736272:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836564.736510:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782875136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836564.736518:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788836564.739382:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782875136:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836565.374525:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836565.759639:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782875264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836565.759724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836565.759822:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875264 00000100:00100000:1.0:1788836565.759830:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875264 00000100:00100000:1.0:1788836565.759884:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788836565.759893:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782875264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836565.759934:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836565.759981:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782875264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836565.759988:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1788836565.760061:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7af480 x1875730782875264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836565.760080:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782875264:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788836565.760108:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836565.760787:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836565.760800:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782875392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836565.760835:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836565.760869:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875392 00000100:00100000:0.0:1788836565.760874:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875392 00000100:00100000:0.0:1788836565.760906:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836565.760925:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782875392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836565.760937:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836565.760971:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782875392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836565.760977:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788836565.760994:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836565.761039:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc21180 x1875730782875392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836565.761056:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782875392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836565.951436:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836565.951532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836565.951567:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836565.951694:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197248 00000100:00100000:3.0:1788836565.951719:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197248 00000100:00100000:3.0:1788836565.951771:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 379 00000100:00100000:3.0:1788836565.951781:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770197248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836565.951847:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770197248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 67us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836565.951855:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 379 00000100:00100000:0.0:1788836565.952115:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836565.955431:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836565.955640:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197504 00000100:00100000:1.0:1788836565.955651:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197504 00000100:00100000:1.0:1788836565.955714:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197760 00000100:00100000:1.0:1788836565.955716:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197760 00000100:00100000:1.0:1788836565.955733:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197376 00000100:00100000:1.0:1788836565.955736:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197376 00000100:00100000:1.0:1788836565.955759:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 267 00000100:00100000:1.0:1788836565.955769:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770197504:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836565.955839:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770197504:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 72us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836565.955846:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 267 00000100:00100000:1.0:1788836565.955864:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 268 00000100:00100000:1.0:1788836565.955869:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770197760:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836565.955922:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770197760:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 52us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836565.955929:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 268 00000100:00100000:1.0:1788836565.955943:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 269 00000100:00100000:1.0:1788836565.955949:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770197376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836565.955973:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770197376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836565.955979:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 269 00000100:00080000:1.0:1788836565.955998:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836565.956002:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836565.962507:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197632 00000100:00100000:1.0:1788836565.962525:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197632 00000100:00100000:1.0:1788836565.962639:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 270 00000100:00100000:1.0:1788836565.962650:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770197632:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836565.962725:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770197632:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (7303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836565.962732:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 270 00000100:00080000:0.0:1788836565.964683:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788836566.399101:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836566.782645:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782875520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836566.782723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836566.783068:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875520 00000100:00100000:2.0:1788836566.783076:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875520 00000100:00100000:2.0:1788836566.783134:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788836566.783144:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782875520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836566.783177:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836566.783464:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782875520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 320us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836566.783472:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788836566.783630:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade437f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782875520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836567.294521:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782875648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836567.294604:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836567.295372:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875648 00000100:00100000:1.0:1788836567.295381:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875648 00000100:00100000:1.0:1788836567.295439:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788836567.295449:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782875648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836567.295478:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836567.295528:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782875648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836567.295535:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788836567.295599:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782875648:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788836567.295920:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836567.296750:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782876032:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.296809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836567.296840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782876544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.296860:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836567.296880:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782877056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.296910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836567.296937:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836567.296943:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782876160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.296965:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836567.296984:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782876672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.297005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297287:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782875904:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297318:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297336:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782876416:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297355:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297380:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782876928:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297398:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297418:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836567.297423:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782875776:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297444:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297459:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782876288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297475:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.297495:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782876800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297532:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876544 00000100:00100000:2.0:1788836567.297539:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876544 00000100:00100000:2.0:1788836567.297582:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877056 00000100:00100000:2.0:1788836567.297585:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877056 00000100:00100000:2.0:1788836567.297596:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876160 00000100:00100000:2.0:1788836567.297598:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876160 00000100:00100000:2.0:1788836567.297607:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875904 00000100:00100000:2.0:1788836567.297608:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875904 00000100:00100000:2.0:1788836567.297616:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876416 00000100:00100000:2.0:1788836567.297618:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876416 00000100:00100000:2.0:1788836567.297628:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876928 00000100:00100000:2.0:1788836567.297630:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876928 00000100:00100000:2.0:1788836567.297642:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788836567.297649:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782876544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297690:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782876544:12345-0@lo:400:kworker.0 Request processed in 41us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297696:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788836567.297709:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788836567.297714:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782877056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297733:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782877056:12345-0@lo:400:kworker.0 Request processed in 19us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297738:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788836567.297745:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788836567.297750:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782876160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297769:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782876160:12345-0@lo:400:kworker.0 Request processed in 19us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297774:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788836567.297801:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788836567.297806:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782875904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297833:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782875904:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297838:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788836567.297847:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788836567.297851:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297871:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782876416:12345-0@lo:400:kworker.0 Request processed in 20us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297876:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788836567.297885:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788836567.297902:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.297927:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782876928:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.297932:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788836567.297975:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876032 00000100:00100000:2.0:1788836567.297979:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876032 00000100:00100000:2.0:1788836567.298001:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876288 00000100:00100000:2.0:1788836567.298004:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876288 00000100:00100000:2.0:1788836567.298037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836567.298458:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782876032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.298497:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782876032:12345-0@lo:400:kworker.0 Request processed in 43us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.298503:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836567.298517:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788836567.298523:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782876288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.298632:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782876288:12345-0@lo:400:kworker.0 Request processed in 109us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.298639:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788836567.298903:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782875776 00000100:00100000:0.0:1788836567.298909:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782875776 00000100:00100000:0.0:1788836567.298961:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788836567.298968:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782875776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.299034:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782875776:12345-0@lo:400:kworker.0 Request processed in 45us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836567.299054:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:0.0:1788836567.299089:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836567.299093:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836567.299575:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782877184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.299612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836567.304029:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876672 00000100:00100000:2.0:1788836567.304045:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876672 00000100:00100000:2.0:1788836567.304136:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788836567.304151:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836567.304238:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782876672:12345-0@lo:400:kworker.0 Request processed in 92us (7230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836567.304245:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788836567.304705:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836567.304973:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782876032:0@lo:400:kworker.0 00010000:00080000:3.0:1788836567.304993:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7ad180 x1875730782876544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836567.305033:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782876544:0@lo:400:kworker.0 00010000:00080000:3.0:1788836567.305060:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcfb100 x1875730782877056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836567.305068:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782877056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.305100:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782876160:0@lo:400:kworker.0 00010000:00080000:3.0:1788836567.305112:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7af480 x1875730782876672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836567.305120:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782876672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.312129:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836567.312218:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782875904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.312234:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782876416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.312246:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782876928:0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.312278:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782875776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836567.312291:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782876288:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.314487:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877184 00000100:00100000:3.0:1788836567.314501:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877184 00000100:00100000:3.0:1788836567.314576:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782876800 00000100:00100000:3.0:1788836567.314579:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782876800 00000100:00100000:3.0:1788836567.314610:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788836567.314619:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782877184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.314704:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782877184:12345-0@lo:400:kworker.0 Request processed in 86us (15091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836567.314710:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788836567.314725:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788836567.314730:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782876800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.314758:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782876800:12345-0@lo:400:kworker.0 Request processed in 28us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836567.314763:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1788836567.314926:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcf9880 x1875730782876800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836567.314953:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782876800:0@lo:400:kworker.0 00000100:00100000:3.0:1788836567.314989:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782877184:0@lo:400:kworker.0 00000100:00080000:0.0:1788836567.316236:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836567.316244:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788836567.322197:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:1.0:1788836567.322207:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf7fc1b000/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:3.0:1788836567.323255:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fc1b000/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-OST0001 00000020:00000080:3.0:1788836567.323318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7fc1c000 for lustre-OST0001 00010000:00010000:0.0:1788836567.422158:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836567.806447:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782877312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836567.806523:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836567.806688:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877312 00000100:00100000:1.0:1788836567.806697:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877312 00000100:00100000:1.0:1788836567.806751:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836567.806762:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782877312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836567.806785:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836567.806841:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782877312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836567.806848:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788836567.806983:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782877312:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836568.448693:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836569.472470:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836569.855508:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836569.855580:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836569.855651:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877440 00000100:00100000:1.0:1788836569.855659:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877440 00000100:00100000:1.0:1788836569.855700:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788836569.855707:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782877440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836569.855739:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836569.855781:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782877440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836569.855788:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788836569.855830:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782877440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788836570.494126:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836570.878212:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782877568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836570.878295:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836570.878376:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877568 00000100:00100000:3.0:1788836570.878384:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877568 00000100:00100000:3.0:1788836570.878439:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788836570.878449:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782877568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836570.878479:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836570.878520:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782877568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836570.878527:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788836570.878550:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836570.878583:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcfa300 x1875730782877568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836570.878601:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782877568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836570.879937:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836570.879995:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836570.880076:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877696 00000100:00100000:3.0:1788836570.880090:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877696 00000100:00100000:3.0:1788836570.880135:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788836570.880142:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782877696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836570.880161:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836570.880199:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782877696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836570.880206:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788836570.880235:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836570.880402:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcfa300 x1875730782877696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836570.880419:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782877696:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788836570.889082:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788836570.950383:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836571.077913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836571.077968:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836571.078069:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836571.078123:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770197888 00000100:00100000:3.0:1788836571.078134:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770197888 00000100:00100000:3.0:1788836571.078186:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 381 00000100:00100000:3.0:1788836571.078196:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770197888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836571.078280:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770197888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836571.078288:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 381 00000100:00100000:2.0:1788836571.086645:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198144 00000100:00100000:2.0:1788836571.086663:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198144 00000100:00080000:1.0:1788836571.086799:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836571.086853:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198400 00000100:00100000:2.0:1788836571.086857:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198400 00000100:00100000:2.0:1788836571.086892:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:2.0:1788836571.086903:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770198144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836571.087043:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 278 00000100:00100000:1.0:1788836571.087053:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770198400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836571.087134:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770198144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 233us (9165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836571.087142:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:1.0:1788836571.091296:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770198400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 4232us (13214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836571.091312:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 278 00000100:00080000:1.0:1788836571.091369:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836571.092767:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836571.093031:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198016 00000100:00100000:1.0:1788836571.093041:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198016 00000100:00080000:1.0:1788836571.093093:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836571.093116:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:0.0:1788836571.093199:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770198016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836571.093391:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770198016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 265us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836571.093483:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836571.093551:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198272 00000100:00100000:2.0:1788836571.093555:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198272 00000100:00080000:1.0:1788836571.096545:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836571.100090:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:2.0:1788836571.110741:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 280 00000100:00100000:2.0:1788836571.110767:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770198272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836571.110902:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770198272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 148us (17419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836571.110911:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 280 00010000:00010000:3.0:1788836571.520448:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836571.904103:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782877824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836571.904178:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836571.904378:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877824 00000100:00100000:0.0:1788836571.904397:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877824 00000100:00100000:0.0:1788836571.904450:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788836571.904460:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782877824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836571.904493:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788836571.904551:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782877824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836571.904557:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788836571.904648:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782877824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836572.418078:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836572.418102:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782877952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836572.418172:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.418513:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782877952 00000100:00100000:2.0:1788836572.418521:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782877952 00000100:00100000:2.0:1788836572.418578:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788836572.418587:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782877952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836572.418616:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836572.418660:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782877952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836572.418668:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788836572.418957:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836572.418998:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782877952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836572.424610:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782878080:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424696:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424737:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782878592:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424783:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782879104:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424816:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424840:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788836572.424858:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782878208:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424896:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782878720:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424924:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424939:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782879232:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.424958:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.424997:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782878464:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425127:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.425156:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782878976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425178:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836572.425186:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878208 00000100:00100000:2.0:1788836572.425193:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782879488:0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425194:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878208 00000100:00100000:2.0:1788836572.425212:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.425228:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836572.425234:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782878336:0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878720 00000100:00100000:1.0:1788836572.425236:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878720 00000100:00100000:2.0:1788836572.425254:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836572.425259:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879232 00000100:00100000:1.0:1788836572.425261:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879232 00000100:00100000:2.0:1788836572.425267:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782878848:0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425273:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878464 00000100:00100000:1.0:1788836572.425275:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878464 00000100:00100000:2.0:1788836572.425286:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836572.425290:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788836572.425296:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782879360:0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425298:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782878208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425312:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836572.425330:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878080 00000100:00100000:2.0:1788836572.425334:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878080 00000100:00100000:1.0:1788836572.425345:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782878208:12345-0@lo:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.425352:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788836572.425359:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788836572.425365:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782878080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425366:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878848 00000100:00100000:1.0:1788836572.425369:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878848 00000100:00100000:1.0:1788836572.425389:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879360 00000100:00100000:1.0:1788836572.425392:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879360 00000100:00100000:2.0:1788836572.425393:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782878080:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.425404:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788836572.425407:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788836572.425424:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782878720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425436:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878592 00000100:00100000:2.0:1788836572.425439:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878592 00000100:00100000:1.0:1788836572.425453:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782878720:12345-0@lo:400:kworker.0 Request processed in 44us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.425459:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788836572.425460:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878336 00000100:00100000:2.0:1788836572.425462:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878336 00000100:00100000:1.0:1788836572.425468:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788836572.425473:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788836572.425473:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782879232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425477:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.425497:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782879232:12345-0@lo:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836572.425502:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782878592:12345-0@lo:400:kworker.0 Request processed in 25us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.425502:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788836572.425507:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788836572.425513:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788836572.425515:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788836572.425518:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782878464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425520:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782878336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425555:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782878336:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836572.425562:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788836572.425580:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879104 00000100:00100000:2.0:1788836572.425584:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879104 00000100:00100000:2.0:1788836572.425605:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782878976 00000100:00100000:2.0:1788836572.425608:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782878976 00000100:00100000:2.0:1788836572.425619:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879488 00000100:00100000:2.0:1788836572.425621:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879488 00000100:00100000:2.0:1788836572.425635:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788836572.425640:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782879104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425670:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782879104:12345-0@lo:400:kworker.0 Request processed in 30us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836572.425675:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788836572.425709:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788836572.425718:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.425826:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788836572.425839:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782878976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.426231:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782878464:12345-0@lo:400:kworker.0 Request processed in 710us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.426238:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788836572.426497:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788836572.426507:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782879360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836572.426539:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782879360:12345-0@lo:400:kworker.0 Request processed in 36us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836572.426545:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788836572.426614:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782878848:12345-0@lo:400:kworker.0 Request processed in 898us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836572.426621:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788836572.427090:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788836572.427100:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782879488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836572.427135:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782879488:12345-0@lo:400:kworker.0 Request processed in 38us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836572.427141:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788836572.429757:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782878976:12345-0@lo:400:kworker.0 Request processed in 3908us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836572.429773:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788836572.429835:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836572.429841:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836572.429845:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836572.429847:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836572.429888:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782878336:0@lo:400:kworker.0 00010000:00080000:2.0:1788836572.429907:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf47f3ce00 x1875730782878848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836572.429917:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782878848:0@lo:400:kworker.0 00010000:00080000:2.0:1788836572.429928:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf47f3e680 x1875730782879360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836572.429935:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782879360:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.429947:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782878464:0@lo:400:kworker.0 00010000:00080000:2.0:1788836572.429957:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf47f3ea00 x1875730782878976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836572.429964:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782878976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.429976:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782879488:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.430216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782878208:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.430229:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782878720:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.430257:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782879232:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.430267:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782878080:0@lo:400:kworker.0 00000100:00100000:2.0:1788836572.430277:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782878592:0@lo:400:kworker.0 00010000:00080000:2.0:1788836572.430288:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf47f3ed80 x1875730782879104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836572.430297:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782879104:0@lo:400:kworker.0 00010000:00010000:2.0:1788836572.542234:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836572.926344:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782879616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836572.926415:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836572.926507:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879616 00000100:00100000:3.0:1788836572.926515:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879616 00000100:00100000:3.0:1788836572.926564:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788836572.926574:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782879616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836572.926596:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836572.926655:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782879616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836572.926672:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788836572.926769:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782879616:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788836573.566180:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836574.591174:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836574.725628:0:14050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:02:53 (1788836573) 00000100:00100000:2.0:1788836574.981473:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836574.981497:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782879744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836574.981575:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836574.981645:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879744 00000100:00100000:2.0:1788836574.981653:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879744 00000100:00100000:2.0:1788836574.981706:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788836574.981715:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782879744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836574.981748:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836574.981813:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782879744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836574.981820:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788836574.982004:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782879744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788836575.628692:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836575.999585:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836575.999609:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836575.999680:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836575.999998:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782880000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836576.000054:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836576.017459:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782879872 00000100:00100000:3.0:1788836576.017475:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782879872 00000100:00100000:3.0:1788836576.018723:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880000 00000100:00100000:3.0:1788836576.018733:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880000 00000100:00100000:1.0:1788836576.019307:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788836576.019322:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782879872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836576.019355:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836576.019448:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782879872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (19768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836576.019455:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1788836576.019513:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fcfa300 x1875730782879872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836576.019532:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782879872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788836576.027808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836576.029391:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788836576.029408:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782880000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836576.029437:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788836576.029838:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fc20700 x1875730782880000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836576.029893:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782880000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836576.030067:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782880000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 664us (30011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836576.030076:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788836576.216229:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.216272:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.216306:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.216331:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.216373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.216400:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198784 00000100:00100000:2.0:1788836576.216411:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198784 00000100:00100000:2.0:1788836576.216465:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199040 00000100:00100000:2.0:1788836576.216468:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199040 00000100:00100000:2.0:1788836576.216484:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198656 00000100:00100000:2.0:1788836576.216487:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198656 00000100:00100000:2.0:1788836576.216578:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198912 00000100:00100000:2.0:1788836576.216582:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198912 00000100:00100000:2.0:1788836576.216602:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:2.0:1788836576.216611:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770198784:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836576.216679:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770198784:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836576.216686:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:2.0:1788836576.216703:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 288 00000100:00100000:2.0:1788836576.216708:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770199040:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836576.216730:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770199040:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836576.216748:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 288 00000100:00100000:2.0:1788836576.216759:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00100000:2.0:1788836576.216765:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770198656:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836576.216786:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770198656:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 21us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836576.216792:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00100000:2.0:1788836576.216802:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 290 00000100:00100000:2.0:1788836576.216808:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770198912:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836576.216837:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770198912:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836576.216843:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 290 00000100:00080000:2.0:1788836576.216859:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836576.216863:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836576.217713:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770198528 00000100:00100000:3.0:1788836576.217723:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770198528 00000100:00100000:3.0:1788836576.217780:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 383 00000100:00100000:3.0:1788836576.217788:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770198528:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836576.217848:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf44281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770198528:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 60us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836576.217855:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 383 00010000:00010000:0.0:1788836576.638183:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836576.672884:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836576.672999:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199168 00000100:00100000:0.0:1788836576.673008:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199168 00000100:00100000:0.0:1788836576.673095:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:0.0:1788836576.673105:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:11090:x1875730770199168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836576.673125:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836576.673190:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa290 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673251:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673264:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673278:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836576.673324:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836576.673328:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836576.673365:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673388:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa290 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673406:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa290 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.673427:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819b00) 00010000:00010000:0.0:1788836576.673431:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836576.673434:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6800, rc 0) 00000100:00100000:0.0:1788836576.673493:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:11090:x1875730770199168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 389us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836576.673500:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:1.0:1788836576.687991:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836576.688061:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199296 00000100:00100000:0.0:1788836576.688071:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199296 00000100:00100000:0.0:1788836576.688137:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:0.0:1788836576.688147:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:11091:x1875730770199296:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836576.688167:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836576.688188:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa297 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688259:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688274:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688285:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688298:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688305:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688325:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688390:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688398:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688405:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836576.688454:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836576.688457:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836576.688475:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688486:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688492:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688499:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688505:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836576.688509:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688516:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688535:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819b00) 00010000:00010000:0.0:1788836576.688537:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836576.688542:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688549:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65542b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688563:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688570:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688575:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688581:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836576.688583:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688590:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688597:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ade43819c00) 00010000:00010000:0.0:1788836576.688599:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836576.688602:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688607:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65542c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688645:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa297 expref: 8 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688659:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa297 expref: 7 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.688666:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ade43819a00) 00010000:00010000:0.0:1788836576.688669:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836576.688671:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6e00, rc 0) 00000100:00100000:0.0:1788836576.688741:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11091:x1875730770199296:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 594us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836576.688749:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:2.0:1788836576.691642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836576.691764:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199424 00000100:00100000:3.0:1788836576.691776:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199424 00000100:00100000:3.0:1788836576.691837:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836576.691848:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11091:x1875730770199424:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788836576.691938:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11091:x1875730770199424:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836576.691945:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836576.700524:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836576.700655:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199680 00000100:00100000:0.0:1788836576.700667:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199680 00000100:00100000:0.0:1788836576.700748:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:0.0:1788836576.700759:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11091:x1875730770199680:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836576.700788:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836576.700813:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65542ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa29e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.700885:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.700900:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.700910:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.700983:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.700994:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701001:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701134:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65542e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701143:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65542e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701150:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65542e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836576.701160:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788836576.701246:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701255:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701262:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701269:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836576.701274:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701292:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701305:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ade43819a00) 00010000:00010000:0.0:1788836576.701308:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836576.701314:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701320:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701333:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701339:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701346:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701351:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836576.701354:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701360:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701367:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ade43819d00) 00010000:00010000:0.0:1788836576.701370:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836576.701372:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701387:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701666:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65542ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa29e expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701680:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65542e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa29e expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836576.701687:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:0.0:1788836576.701689:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836576.701691:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6200, rc 0) 00000100:00100000:0.0:1788836576.701830:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11091:x1875730770199680:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1318us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788836576.701839:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:0.0:1788836576.712505:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836576.712609:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199808 00000100:00100000:2.0:1788836576.712620:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199808 00000100:00100000:2.0:1788836576.712679:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788836576.712689:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11091:x1875730770199808:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788836576.712824:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11091:x1875730770199808:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836576.712832:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1788836576.721559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836576.721654:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770199936 00000100:00100000:0.0:1788836576.721664:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770199936 00000100:00100000:0.0:1788836576.721736:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:0.0:1788836576.721746:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:11091:x1875730770199936:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788836576.726328:0:12185:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4536us 00000100:00100000:1.0:1788836576.753343:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:11091:x1875730770199936:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 31586us (31782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836576.753358:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000040:00080000:0.0:1788836577.024205:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836577.024573:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782880128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836577.024656:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836577.024825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880128 00000100:00100000:2.0:1788836577.024833:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880128 00000100:00100000:2.0:1788836577.024881:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788836577.024890:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782880128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836577.024923:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836577.024975:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782880128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836577.024982:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788836577.025069:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782880128:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788836577.086731:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836577.538298:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836577.538320:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782880256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836577.538399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836577.538460:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880256 00000100:00100000:1.0:1788836577.538467:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880256 00000100:00100000:1.0:1788836577.538518:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788836577.538527:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782880256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836577.538562:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836577.538603:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782880256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836577.538610:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788836577.538629:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836577.538661:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782880256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836577.538839:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782880512:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.538872:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.538896:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782881024:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.538926:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.538963:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782881536:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.538984:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539006:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788836577.539068:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782880384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539095:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539116:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782880896:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539139:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539156:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782881408:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539178:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539205:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880512 00000100:00100000:0.0:1788836577.539209:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880512 00000100:00100000:0.0:1788836577.539240:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881024 00000100:00100000:0.0:1788836577.539242:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881024 00000100:00100000:0.0:1788836577.539262:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881536 00000100:00100000:0.0:1788836577.539265:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881536 00000100:00100000:0.0:1788836577.539283:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788836577.539290:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782880512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539328:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782880512:12345-0@lo:400:kworker.0 Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788836577.539348:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788836577.539353:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782881024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539380:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782881024:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539385:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788836577.539405:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788836577.539411:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539439:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782881536:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539445:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788836577.539468:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880384 00000100:00100000:0.0:1788836577.539472:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880384 00000100:00100000:0.0:1788836577.539494:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788836577.539500:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782880384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539528:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782880384:12345-0@lo:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539535:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788836577.539562:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880896 00000100:00100000:0.0:1788836577.539566:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880896 00000100:00100000:0.0:1788836577.539589:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788836577.539596:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539626:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782880896:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539631:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788836577.539649:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881408 00000100:00100000:0.0:1788836577.539652:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881408 00000100:00100000:0.0:1788836577.539675:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788836577.539682:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539723:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782881408:12345-0@lo:400:kworker.0 Request processed in 42us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.539730:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788836577.539762:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836577.539778:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782880640:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539822:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782881152:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539853:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539870:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782881664:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539907:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836577.539912:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782880768:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539943:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782881280:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539962:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.539976:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782881792:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.539994:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836577.540037:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880640 00000100:00100000:0.0:1788836577.540041:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880640 00000100:00100000:0.0:1788836577.540066:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788836577.540072:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782880640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540104:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782880640:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540109:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788836577.540123:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881280 00000100:00100000:0.0:1788836577.540126:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881280 00000100:00100000:0.0:1788836577.540143:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881792 00000100:00100000:0.0:1788836577.540145:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881792 00000100:00100000:0.0:1788836577.540168:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788836577.540173:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540209:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782881280:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540214:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788836577.540224:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788836577.540229:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540251:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782881792:12345-0@lo:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788836577.540272:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881152 00000100:00100000:0.0:1788836577.540275:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881152 00000100:00100000:0.0:1788836577.540294:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881664 00000100:00100000:0.0:1788836577.540296:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881664 00000100:00100000:0.0:1788836577.540307:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782880768 00000100:00100000:0.0:1788836577.540310:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782880768 00000100:00100000:0.0:1788836577.540323:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788836577.540329:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782881152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540354:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782881152:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540359:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788836577.540369:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788836577.540374:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540395:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782881664:12345-0@lo:400:kworker.0 Request processed in 21us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540401:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788836577.540409:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788836577.540414:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782880768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540445:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782880768:12345-0@lo:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836577.540451:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1788836577.540474:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836577.540477:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836577.540503:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782880384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540514:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782880896:0@lo:400:kworker.0 00010000:00080000:0.0:1788836577.540525:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44556300 x1875730782881408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836577.540535:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782881408:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540544:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782880512:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540553:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782881024:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540562:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782881536:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540591:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782880768:0@lo:400:kworker.0 00010000:00080000:0.0:1788836577.540600:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44557100 x1875730782881280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836577.540608:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782881280:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540616:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782881792:0@lo:400:kworker.0 00000100:00100000:0.0:1788836577.540624:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782880640:0@lo:400:kworker.0 00010000:00080000:0.0:1788836577.540632:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44555f80 x1875730782881152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836577.540651:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782881152:0@lo:400:kworker.0 00010000:00080000:0.0:1788836577.540662:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44554a80 x1875730782881664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836577.540670:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782881664:0@lo:400:kworker.0 00010000:00010000:3.0:1788836577.670823:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836578.049894:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836578.049929:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782881920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836578.050046:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836578.050119:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782881920 00000100:00100000:1.0:1788836578.050128:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782881920 00000100:00100000:1.0:1788836578.050176:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836578.050185:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782881920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836578.050211:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836578.050255:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782881920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836578.050262:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836578.050319:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782881920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836578.686208:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836578.997148:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836578.997214:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200064 00000100:00100000:0.0:1788836578.997230:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200064 00000100:00100000:0.0:1788836578.997324:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:0.0:1788836578.997338:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11133:x1875730770200064:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836578.997361:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836578.997386:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2a5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997466:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997481:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997491:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997505:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997512:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997517:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997567:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997573:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997580:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997586:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836578.997590:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997597:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997609:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819b00) 00010000:00010000:0.0:1788836578.997611:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836578.997616:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997622:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a65542f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997634:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997640:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997645:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997656:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836578.997659:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997666:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997674:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ade43819d00) 00010000:00010000:0.0:1788836578.997676:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836578.997679:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997697:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65542ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997728:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2a5 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997738:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819b00) 00010000:00010000:0.0:1788836578.997742:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836578.997745:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65542f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2a5 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836578.997753:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00100000:0.0:1788836578.997825:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11133:x1875730770200064:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 491us (692us total) trans 0 rc 301/301 00000100:00100000:0.0:1788836578.997833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00080000:2.0:1788836578.998098:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836579.017837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836579.019170:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200320 00000100:00100000:2.0:1788836579.019184:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200320 00000100:00100000:2.0:1788836579.019255:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1788836579.019277:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11133:x1875730770200320:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:2.0:1788836579.019342:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836579.019370:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65542ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa290 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019387:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819b00) 00010000:00010000:2.0:1788836579.019396:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836579.019459:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019474:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019483:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019496:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019502:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.019509:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020003:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020053:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020061:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836579.020083:0:12185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097c647b8 reply state 00000000b4ca91d7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020094:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020100:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836579.020103:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836579.020106:0:12185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836579.020111:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788836579.020119:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020125:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020132:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020138:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836579.020142:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020149:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020158:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf785f7800) 00010000:00010000:2.0:1788836579.020160:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836579.020163:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020179:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554306 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836579.020193:0:12185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097c647b8 reply state 00000000b4ca91d7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020202:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.020207:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adf785f7600) 00010000:00010000:2.0:1788836579.020210:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836579.020211:0:12185:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788836579.020314:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:11133:x1875730770200320:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 1040us (2485us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788836579.020321:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788836579.106520:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.106624:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200448 00000100:00100000:0.0:1788836579.106640:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200448 00000100:00100000:0.0:1788836579.106724:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1788836579.106735:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:11141:x1875730770200448:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:0.0:1788836579.106760:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.106782:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a655431b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2ac expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.106845:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.106860:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.106873:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.106914:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836579.106918:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836579.106955:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.106979:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a655431b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ac expref: 12 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.106997:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ac expref: 11 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.107005:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836579.107008:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836579.107063:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7200, rc 0) 00000100:00100000:0.0:1788836579.107191:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:11141:x1875730770200448:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 456us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.107199:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788836579.181102:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.181319:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200576 00000100:00100000:0.0:1788836579.181330:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200576 00000100:00100000:0.0:1788836579.181397:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788836579.181406:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:11147:x1875730770200576:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836579.181486:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.181511:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2b3 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181583:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181598:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181609:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181621:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181628:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181647:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181747:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181769:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181777:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.181814:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788836579.181817:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836579.181858:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181872:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181879:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181886:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181893:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.181898:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181905:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181918:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836579.181921:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836579.181926:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181941:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181956:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181962:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181968:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181973:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.181977:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181983:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.181991:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adf785f7600) 00010000:00010000:0.0:1788836579.181994:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836579.181997:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.182003:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554337 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.182308:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2b3 expref: 13 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.182334:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2b3 expref: 12 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.182341:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836579.182343:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788836579.182346:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7c00, rc 0) 00000100:00100000:0.0:1788836579.182416:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11147:x1875730770200576:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1010us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.182433:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788836579.193305:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836579.193388:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200832 00000100:00100000:3.0:1788836579.193399:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200832 00000100:00100000:3.0:1788836579.193468:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788836579.193479:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11147:x1875730770200832:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836579.193499:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836579.193522:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554345 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2ba expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193636:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193651:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193662:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193735:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193745:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.193752:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836579.194249:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788836579.194402:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194413:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194420:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194450:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194458:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194465:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194472:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836579.194477:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194485:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194496:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:3.0:1788836579.194499:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836579.194503:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194520:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655434c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836579.194535:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066285c29 reply state 00000000ef0bae05 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194546:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194552:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:3.0:1788836579.194554:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836579.194557:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836579.194824:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554345 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194840:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.194848:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:3.0:1788836579.194851:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836579.194853:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82172c00, rc 0) 00000100:00100000:3.0:1788836579.194926:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:11147:x1875730770200832:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1448us (1631us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788836579.194933:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788836579.198826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.198907:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770200960 00000100:00100000:0.0:1788836579.198919:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770200960 00000100:00100000:0.0:1788836579.198978:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788836579.198986:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875730770200960:12345-192.168.201.38@tcp:8:bash.0 00010000:00080000:0.0:1788836579.199054:0:8407:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:0.0:1788836579.199087:0:8407:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a6554368 00002000:00100000:0.0:1788836579.199098:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b8fbf20-a55f-40bb-87b6-19e878cca24b/ffff8adf81447800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836579.199126:0:8407:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788836579.199249:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788836579.199284:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf81443800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836579.199363:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770200960:12345-192.168.201.38@tcp:8:bash.0 Request processed in 374us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.199371:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836579.205943:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.206035:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770201088 00000100:00100000:0.0:1788836579.206058:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770201088 00000100:00100000:0.0:1788836579.206144:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788836579.206156:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770201088:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836579.206174:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.206198:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2c1 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836579.206224:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836579.206242:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788836579.206247:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836579.206257:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.206276:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.206290:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836579.206346:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:0:x1875730770201088:12345-192.168.201.38@tcp:101:bash.0 Request processed in 193us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.206353:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00080000:2.0:1788836579.207138:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836579.214153:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.214286:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770201216 00000100:00100000:0.0:1788836579.214297:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770201216 00000100:00100000:0.0:1788836579.214358:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:0.0:1788836579.214368:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11147:x1875730770201216:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836579.214388:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.214407:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2c8 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.214455:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.214465:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836579.214469:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836579.214474:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.214509:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.214523:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836579.214537:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782882048:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836579.214859:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45463d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836579.221547:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782882048:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836579.221597:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.221619:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7800, rc 0) 00000100:00100000:0.0:1788836579.221695:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:11147:x1875730770201216:12345-192.168.201.38@tcp:101:bash.0 Request processed in 7327us (7552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.221706:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836579.222353:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.225248:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770201344 00000100:00100000:0.0:1788836579.225264:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770201344 00010000:00010000:1.0:1788836579.228200:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836579.228313:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836579.228325:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770201344:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836579.228362:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836579.228387:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.228401:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.228429:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cec06db/0xf7b38383a655436f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c1 expref: 8 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.228449:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836579.228454:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836579.228463:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.228475:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.228519:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836579.228534:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6475:1875730782882176:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788836579.228638:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf461116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836579.232510:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.233335:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770201600 00000100:00100000:0.0:1788836579.233347:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770201600 00000100:00100000:0.0:1788836579.233413:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788836579.233424:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:11147:x1875730770201600:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:0.0:1788836579.233755:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11147:x1875730770201600:12345-192.168.201.38@tcp:35:bash.0 Request processed in 332us (1255us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788836579.233763:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788836579.236400:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6475:1875730782882176:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788836579.236440:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836579.236742:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770201344:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 8418us (14390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836579.236755:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836579.334340:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.337918:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770201856 00000100:00100000:0.0:1788836579.337934:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770201856 00000100:00100000:0.0:1788836579.338057:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788836579.338069:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11157:x1875730770201856:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836579.338095:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.338115:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a655437d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2cf expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.338212:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788836579.338316:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a655437d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2cf expref: 18 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.338330:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836579.338334:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836579.338339:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a655437d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2cf expref: 18 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.338352:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836579.338419:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11157:x1875730770201856:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 353us (4091us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788836579.338452:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788836579.348426:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.348540:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770202112 00000100:00100000:0.0:1788836579.348551:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770202112 00000100:00100000:0.0:1788836579.348629:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788836579.348641:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11157:x1875730770202112:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836579.348923:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11157:x1875730770202112:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 283us (507us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788836579.348931:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788836579.461994:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836579.462208:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770202240 00000100:00100000:2.0:1788836579.462219:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770202240 00000100:00100000:2.0:1788836579.462283:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:2.0:1788836579.462294:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11163:x1875730770202240:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836579.462319:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836579.462342:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a655438b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2d6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462413:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462427:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462450:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836579.462505:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788836579.462509:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836579.462533:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462563:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a655438b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2d6 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462582:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2d6 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.462590:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836579.462593:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836579.462597:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46600, rc 0) 00000100:00100000:2.0:1788836579.462668:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11163:x1875730770202240:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 375us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836579.462685:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1788836579.469398:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836579.469634:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770202496 00000100:00100000:3.0:1788836579.469667:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770202496 00000100:00100000:3.0:1788836579.469788:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788836579.469800:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11163:x1875730770202496:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836579.469822:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836579.469844:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554399 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2dd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.469973:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.469988:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.470000:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836579.470055:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788836579.470190:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2dd expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.470209:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2dd expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.470218:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:3.0:1788836579.470221:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836579.470225:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:3.0:1788836579.470280:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:11163:x1875730770202496:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 482us (892us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788836579.470287:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836579.482644:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.482884:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770202752 00000100:00100000:0.0:1788836579.482895:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770202752 00000100:00100000:0.0:1788836579.482964:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788836579.482976:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:11163:x1875730770202752:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836579.483005:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.483293:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65543ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2e4 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.483421:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.483438:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.483451:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.483466:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788836579.483584:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65543ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2e4 expref: 24 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.484350:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2e4 expref: 23 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.484360:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:0.0:1788836579.484364:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788836579.484368:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836579.484434:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:11163:x1875730770202752:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1459us (1800us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788836579.484443:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788836579.484554:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836579.484605:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770202880 00000100:00100000:3.0:1788836579.484612:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770202880 00000100:00100000:3.0:1788836579.484663:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1788836579.484672:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2397:x1875730770202880:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836579.484697:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836579.484715:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2dd expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.484727:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:3.0:1788836579.484731:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836579.484770:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2397:x1875730770202880:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836579.484776:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1788836579.499906:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.500277:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203008 00000100:00100000:0.0:1788836579.500289:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203008 00000100:00100000:0.0:1788836579.500357:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:0.0:1788836579.500369:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770203008:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:0.0:1788836579.500418:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.500442:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.500452:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836579.500456:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836579.500460:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.500506:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.500535:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 7 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836579.500550:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782882304:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836579.500783:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42be1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836579.508202:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782882304:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836579.508238:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836579.511956:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.512082:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203136 00000100:00100000:0.0:1788836579.512094:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203136 00002000:00100000:0.0:1788836579.512156:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ade44550380 x1875730770203136/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:745/0 lens 504/0 e 0 to 0 dl 1788836590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836579.512168:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade44550380 with x1875730770203136 ext(0->12) 00010000:00010000:0.0:1788836579.512179:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 8 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.512198:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 8 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836579.512206:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade44550380 00000100:00100000:0.0:1788836579.512243:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788836579.512255:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770203136:12345-192.168.201.38@tcp:4:lfs.0 00000001:00100000:0.0:1788836579.526225:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000100:00100000:1.0:1788836579.532591:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770203136:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 20327us (20635us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788836579.532612:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:1.0:1788836579.532627:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ade44550380 x1875730770203136/t4294967300(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:745/0 lens 504/448 e 0 to 0 dl 1788836590 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836579.532637:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade44550380 with x1875730770203136 ext(0->12) 00010000:00010000:1.0:1788836579.532648:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.532670:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836579.532687:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade44550380 00000100:00100000:2.0:1788836579.543237:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.543326:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203264 00000100:00100000:0.0:1788836579.543336:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203264 00010000:00010000:0.0:1788836579.543374:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836579.543420:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788836579.544162:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2394:x1875730770203264:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836579.544184:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788836579.544205:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788836579.544209:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788836579 00002000:00010000:0.0:1788836579.544211:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788836579 00002000:00010000:0.0:1788836579.544213:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788836579 00002000:00010000:0.0:1788836579.544216:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788836579.544223:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.544239:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.544263:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c8222fb/0xf7b38383a6554376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2c8 expref: 9 pid: 8407 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.544281:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836579.544285:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836579.544292:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.544316:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.544349:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836579.545084:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770203264:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 988us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.545095:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00010000:00010000:2.0:1788836579.545308:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545322:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545363:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545373:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545381:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545389:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836579.545393:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545403:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545421:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836579.545440:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb2e587/0xf7b38383a65543c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836579.545504:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770203008:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 45138us (45610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836579.545513:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1788836579.566069:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836579.566141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203520 00000100:00100000:3.0:1788836579.566152:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203520 00000100:00100000:3.0:1788836579.566208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1788836579.566219:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11163:x1875730770203520:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:3.0:1788836579.566287:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2e4 expref: 22 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836579.566513:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788836579.566566:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788836579.567296:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788836579.567340:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.567356:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.567378:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.567416:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.567433:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 26 pid: 6492 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836579.567448:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1875730782882432:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836579.567553:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42aaa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836579.575949:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836579.576058:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203648 00000100:00100000:3.0:1788836579.576064:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1875730782882432:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836579.576066:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203648 00010000:00010000:3.0:1788836579.576088:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576113:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 27 pid: 6492 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836579.576158:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:1.0:1788836579.576167:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:2394:x1875730770203648:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836579.576183:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836579.576190:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 27 pid: 6492 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576203:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 27 pid: 6492 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576224:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655435a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ba expref: 27 pid: 6492 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576239:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:1.0:1788836579.576245:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576255:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576263:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.576291:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836579.576339:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:2394:x1875730770203648:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 172us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836579.576347:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00010000:00010000:3.0:1788836579.576559:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836579.576568:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836579.576687:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788836579.576813:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788836579.576898:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1875730782882560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788836579.576942:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836579.576978:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42aaa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836579.577053:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782882560 00000100:00100000:0.0:1788836579.577059:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782882560 00000100:00100000:0.0:1788836579.577121:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788836579.577167:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836579.577204:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1875730782882560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788836579.577288:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1875730782882560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 160us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836579.577335:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1875730782882560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788836579.577486:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788836579.577533:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44550a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1875730782882688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788836579.577563:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836579.577591:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf461119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836579.577712:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782882688 00000100:00100000:2.0:1788836579.577718:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782882688 00000100:00100000:0.0:1788836579.584163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788836579.585620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788836579.585655:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1875730782882688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788836579.585883:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6494:x1875730782882688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 235us (8318us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788836579.585891:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836579.588353:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44550a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1875730782882688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788836579.588452:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788836579.588517:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588528:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588536:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588543:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836579.588548:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588556:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588574:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:1.0:1788836579.588577:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788836579.588582:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.588588:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65543ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836579.588753:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788836579.588819:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788836579.588830:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363494817546ns, next at 364494815786ns, rc = 0 00000001:00080000:1.0:1788836579.588836:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788836579.588859:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf439d0900) 00010000:00010000:1.0:1788836579.588863:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788836579.588869:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a65543b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2e4 expref: 30 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836579.588988:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:11163:x1875730770203520:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 22770us (22928us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788836579.588997:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000020:00080000:1.0:1788836579.589003:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788836579.600794:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.600886:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770203776 00000100:00100000:0.0:1788836579.600897:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770203776 00000100:00100000:0.0:1788836579.600962:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:0.0:1788836579.600973:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:11163:x1875730770203776:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836579.601000:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.601063:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65543d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2eb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.601123:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65543d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2eb expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.601156:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65543d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2eb expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.601178:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836579.601181:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836579.601185:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7800, rc 0) 00000100:00100000:0.0:1788836579.601252:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11163:x1875730770203776:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 282us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.601260:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:2.0:1788836579.610382:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.610476:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770204032 00000100:00100000:0.0:1788836579.610485:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770204032 00000100:00100000:0.0:1788836579.610542:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1788836579.610554:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11163:x1875730770204032:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836579.610849:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+31:11163:x1875730770204032:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 296us (477us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788836579.610857:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00010000:00010000:0.0:1788836579.710193:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836579.725160:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.729717:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770204288 00000100:00100000:0.0:1788836579.729735:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770204288 00000100:00100000:0.0:1788836579.729817:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1788836579.729827:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+31:11173:x1875730770204288:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836579.729851:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.729871:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65543d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2f2 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.729990:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788836579.730127:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65543d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f2 expref: 33 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.730142:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836579.730144:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836579.730149:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65543d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f2 expref: 33 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.730162:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836579.730228:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11173:x1875730770204288:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 402us (5079us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788836579.730235:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788836579.732877:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.732964:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770204416 00000100:00100000:0.0:1788836579.732974:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770204416 00000100:00100000:0.0:1788836579.733064:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:0.0:1788836579.733075:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11173:x1875730770204416:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788836579.733158:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733176:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733187:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733198:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733219:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733225:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733310:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733320:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733327:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836579.733376:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733390:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733397:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733404:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733409:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.733413:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733420:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733440:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836579.733442:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836579.733447:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733453:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65543e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733466:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733471:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733478:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733483:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.733486:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733492:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733498:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:0.0:1788836579.733500:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836579.733502:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733507:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65543ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733527:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733533:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733539:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733545:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.733548:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733554:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733561:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836579.733564:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836579.733566:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.733572:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836579.733644:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11173:x1875730770204416:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 571us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.733652:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:2.0:1788836579.738901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.738979:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770204672 00000100:00100000:0.0:1788836579.738991:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770204672 00000100:00100000:0.0:1788836579.739080:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788836579.739117:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11173:x1875730770204672:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836579.739337:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:11173:x1875730770204672:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 233us (445us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788836579.739345:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788836579.816416:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.816533:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770204928 00000100:00100000:0.0:1788836579.816547:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770204928 00000100:00100000:0.0:1788836579.816611:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788836579.816622:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:11176:x1875730770204928:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836579.816645:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836579.816666:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa2f9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816782:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816798:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816808:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816820:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816827:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816834:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816960:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816970:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.816977:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836579.816986:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788836579.819755:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819773:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819781:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819788:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836579.819792:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819801:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819840:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836579.819843:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836579.819848:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819855:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554402 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819874:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819880:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819885:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819891:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836579.819894:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819900:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819907:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:1.0:1788836579.819909:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836579.819912:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819918:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554409 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.819989:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65543fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 36 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.820004:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836579.820198:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836579.820200:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836579.820203:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:1.0:1788836579.820282:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11176:x1875730770204928:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3661us (3873us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788836579.820291:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1788836579.832106:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836579.837618:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770205056 00000100:00100000:0.0:1788836579.837635:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770205056 00000100:00100000:0.0:1788836579.837789:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1788836579.837802:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11176:x1875730770205056:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788836579.837882:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837898:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837909:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837943:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837950:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837957:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837978:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836579.837982:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.837989:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.838002:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836579.838005:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836579.838059:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836579.838066:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655441e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836579.838153:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11176:x1875730770205056:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 353us (6145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836579.838161:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:2.0:1788836579.844060:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836579.844145:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770205312 00000100:00100000:1.0:1788836579.844154:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770205312 00000100:00100000:1.0:1788836579.844215:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788836579.844225:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11176:x1875730770205312:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836579.844613:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+36:11176:x1875730770205312:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 387us (560us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788836579.844620:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000040:00080000:1.0:1788836580.096093:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788836580.096714:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836580.096743:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf47f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782882816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836580.096817:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836580.097435:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782882816 00000100:00100000:2.0:1788836580.097444:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782882816 00000100:00100000:2.0:1788836580.097498:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788836580.097507:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782882816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836580.097539:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836580.097603:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782882816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836580.097610:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788836580.097742:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf47f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782882816:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788836580.159118:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836580.187383:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836580.187473:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770205568 00000100:00100000:0.0:1788836580.187484:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770205568 00000100:00100000:0.0:1788836580.187560:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1788836580.187572:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+36:11207:x1875730770205568:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788836580.187596:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836580.187619:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554425 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa300 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.187769:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655442c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.187784:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655442c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.187797:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655442c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836580.187809:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788836580.187961:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554425 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa300 expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.187979:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655442c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa300 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.187988:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.187991:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836580.187994:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00080000:1.0:1788836580.188119:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836580.188258:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11207:x1875730770205568:12345-192.168.201.38@tcp:101:cat.0 Request processed in 688us (887us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788836580.188265:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1788836580.200924:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836580.200977:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836580.201123:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770205824 00000100:00100000:1.0:1788836580.201151:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770205824 00000100:00100000:1.0:1788836580.201228:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788836580.201251:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11207:x1875730770205824:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1788836580.201498:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:11207:x1875730770205824:12345-192.168.201.38@tcp:35:cat.0 Request processed in 248us (590us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788836580.201506:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1788836580.203080:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770205952 00000100:00100000:3.0:1788836580.204045:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770205952 00000100:00100000:3.0:1788836580.204544:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788836580.204559:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:2396:x1875730770205952:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836580.204584:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836580.204619:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655442c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa300 expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.204648:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836580.204655:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836580.205941:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:2396:x1875730770205952:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1373us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836580.205956:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1788836580.276106:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836580.277065:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770206208 00000100:00100000:3.0:1788836580.277083:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770206208 00000100:00100000:3.0:1788836580.277191:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:3.0:1788836580.277206:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11213:x1875730770206208:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836580.277675:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836580.277680:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788836580.277721:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2d6 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.277932:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:3.0:1788836580.277939:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836580.277959:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655443a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa307 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.278248:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.278266:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.278276:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.278322:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.278340:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 38 pid: 6491 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836580.278358:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782882944:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836580.278514:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42aaa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836580.284868:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836580.284965:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770206336 00000100:00100000:0.0:1788836580.284980:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770206336 00010000:00010000:0.0:1788836580.285073:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 39 pid: 6491 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836580.285108:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782882944:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836580.285116:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1788836580.285147:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:2394:x1875730770206336:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836580.285168:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836580.285177:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 39 pid: 6491 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285193:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 39 pid: 6491 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285223:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2f9 expref: 39 pid: 6491 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285242:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.285248:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285259:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285269:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.285294:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836580.285362:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836580.285362:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:2394:x1875730770206336:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 216us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836580.285378:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00010000:00010000:3.0:1788836580.285381:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.285396:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836580.285421:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788836580.287152:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655443a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 39 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.287184:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 38 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.287210:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.287214:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836580.287218:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:0.0:1788836580.287286:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11213:x1875730770206208:12345-192.168.201.38@tcp:101:dd.0 Request processed in 10083us (11194us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788836580.287295:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1788836580.291569:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836580.291884:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770206464 00000100:00100000:3.0:1788836580.291901:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770206464 00000100:00100000:3.0:1788836580.291989:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1788836580.292001:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11213:x1875730770206464:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836580.292372:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836580.292403:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655444f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa30e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.292452:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.292472:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.292485:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.293830:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655444f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.293870:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836580.293881:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836580.293899:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836580.293905:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46600, rc 0) 00000100:00100000:3.0:1788836580.294006:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:11213:x1875730770206464:12345-192.168.201.38@tcp:101:dd.0 Request processed in 2005us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836580.294096:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:1.0:1788836580.297589:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836580.297693:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770206720 00000100:00100000:0.0:1788836580.297708:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770206720 00000100:00100000:0.0:1788836580.299778:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:0.0:1788836580.299814:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:11213:x1875730770206720:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:0.0:1788836580.300180:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.300202:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.300215:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836580.300407:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788836580.300438:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000744ef763 reply state 0000000099a0419a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.300459:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.300468:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.300472:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836580.300497:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836580.300631:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:11213:x1875730770206720:12345-192.168.201.38@tcp:36:dd.0 Request processed in 836us (3057us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788836580.300642:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000020:00080000:0.0:1788836580.300649:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788836580.594156:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836580.594459:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770206848 00000100:00100000:1.0:1788836580.594472:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770206848 00000100:00100000:1.0:1788836580.594565:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788836580.594578:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:11227:x1875730770206848:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:1.0:1788836580.594613:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836580.594644:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554464 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa315 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594778:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594798:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594814:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594829:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594838:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594882:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.594994:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.595006:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 43 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.595068:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.595117:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 43 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836580.595133:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 43 pid: 10681 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836580.595151:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44550700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782883072:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836580.595310:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836580.603407:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44550700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782883072:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836580.603457:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836580.605178:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836580.605338:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770207104 00000100:00100000:1.0:1788836580.605353:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770207104 00000100:00100000:1.0:1788836580.605437:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788836580.605451:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:6169:x1875730770207104:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836580.606357:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:6169:x1875730770207104:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 900us (1184us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788836580.606370:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788836580.618156:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836580.619127:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770207232 00000100:00100000:0.0:1788836580.619148:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770207232 00010000:00010000:0.0:1788836580.619228:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 45 pid: 10681 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836580.619296:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:0.0:1788836580.619309:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:2396:x1875730770207232:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836580.619333:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836580.619342:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 45 pid: 10681 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619360:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 45 pid: 10681 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619389:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554441 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa307 expref: 45 pid: 10681 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619412:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.619418:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619429:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619460:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.619519:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836580.619646:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:2396:x1875730770207232:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 339us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836580.619667:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00010000:00010000:2.0:1788836580.620302:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620330:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836580.620411:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788836580.620418:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836580.620474:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620506:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620518:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620524:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620532:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620539:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836580.620543:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620552:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620566:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836580.620570:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836580.620575:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620591:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655446b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620608:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620615:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620621:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620625:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836580.620628:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620634:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620642:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:2.0:1788836580.620645:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836580.620648:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620654:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620713:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa315 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620729:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa315 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836580.620743:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836580.620745:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836580.620748:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:2.0:1788836580.620820:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:11227:x1875730770206848:12345-192.168.201.38@tcp:101:stat.0 Request processed in 26244us (26679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836580.620828:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00010000:00010000:3.0:1788836580.735668:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836580.784208:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836580.784378:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770207488 00000100:00100000:0.0:1788836580.784392:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770207488 00000100:00100000:0.0:1788836580.784479:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1788836580.784492:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:11233:x1875730770207488:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:0.0:1788836580.784623:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836580.784670:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa315 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.784694:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.784700:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836580.784950:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.784967:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.784978:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836580.785098:0:12185:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788836580.785123:0:12185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a646b1f reply state 000000001c627ea9 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.785144:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836580.785150:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836580.785152:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836580.785155:0:12185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836580.785298:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:11233:x1875730770207488:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 807us (1107us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788836580.785306:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000020:00080000:0.0:1788836580.785312:0:12185:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788836581.002446:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.002578:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770207616 00000100:00100000:2.0:1788836581.002592:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770207616 00000100:00100000:2.0:1788836581.002681:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1788836581.002694:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:11247:x1875730770207616:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:2.0:1788836581.002726:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836581.002753:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554487 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa31c expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002847:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002867:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002882:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002895:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002903:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.002937:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003090:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003101:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003108:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836581.003165:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788836581.003171:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836581.003195:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003210:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003220:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003227:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003235:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003242:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836581.003248:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003264:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003282:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836581.003285:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836581.003292:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003299:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655448e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003319:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003326:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003334:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003339:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836581.003343:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003349:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003355:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:2.0:1788836581.003358:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836581.003361:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003383:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003421:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554487 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 47 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003438:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 46 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.003446:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836581.003448:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836581.003451:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836581.003540:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:11247:x1875730770207616:12345-192.168.201.38@tcp:101:stat.0 Request processed in 848us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.003549:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788836581.085533:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.085720:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770207872 00000100:00100000:0.0:1788836581.085738:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770207872 00000100:00100000:0.0:1788836581.086743:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:0.0:1788836581.086762:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:11257:x1875730770207872:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836581.086797:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.086827:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa323 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.086966:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788836581.088303:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa323 expref: 48 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.088329:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836581.088332:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836581.088339:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa323 expref: 48 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.088382:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836581.088483:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:11257:x1875730770207872:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1725us (2958us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788836581.088495:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788836581.092644:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836581.092881:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770208128 00000100:00100000:3.0:1788836581.092895:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770208128 00000100:00100000:3.0:1788836581.093050:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788836581.093062:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:11257:x1875730770208128:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836581.093370:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+48:11257:x1875730770208128:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 310us (744us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788836581.093379:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000004:00080000:3.0:1788836581.118839:0:8495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365024823775ns, next at 366024820835ns, rc = 0 00000100:00100000:3.0:1788836581.118863:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836581.118885:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782883200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836581.118957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836581.119043:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782883200 00000100:00100000:3.0:1788836581.119052:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782883200 00000100:00100000:3.0:1788836581.119117:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788836581.119126:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782883200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836581.119154:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788836581.119206:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782883200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836581.119212:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788836581.119231:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836581.119291:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782883200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836581.120369:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782883328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836581.120698:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836581.120840:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782883328 00000100:00100000:2.0:1788836581.120848:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782883328 00000100:00100000:2.0:1788836581.120912:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788836581.120921:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782883328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836581.120939:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788836581.120982:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782883328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.120989:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788836581.121058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782883328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836581.121267:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836581.184119:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.184259:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770208384 00000100:00100000:0.0:1788836581.184270:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770208384 00000100:00100000:0.0:1788836581.184353:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:0.0:1788836581.184366:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+48:11263:x1875730770208384:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836581.184399:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.184423:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa32a expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.184553:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.184569:0:12185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 49 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.184577:0:12185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.184614:0:12185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 49 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.184630:0:12185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 49 pid: 10333 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836581.184674:0:12185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44558000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782883456:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836581.184806:0:12185:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836581.197594:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.197731:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770208512 00000100:00100000:2.0:1788836581.197741:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770208512 00010000:00010000:2.0:1788836581.197802:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 50 pid: 10333 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836581.197847:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1788836581.197859:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:2394:x1875730770208512:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836581.197876:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836581.197884:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 50 pid: 10333 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.197898:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 50 pid: 10333 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.197925:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836581.197930:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.197941:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.197948:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.197969:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836581.198061:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:2394:x1875730770208512:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 203us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.198069:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00010000:00010000:0.0:1788836581.198727:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a655449c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa31c expref: 49 pid: 10333 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836581.198747:0:12185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44558000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782883456:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836581.198769:0:12185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.198779:0:12185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.198784:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.198803:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788836581.198948:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 50 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.198964:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 49 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.198971:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.198974:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836581.198977:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836581.199521:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:11263:x1875730770208384:12345-192.168.201.38@tcp:101:bash.0 Request processed in 15155us (15408us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788836581.199555:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:1.0:1788836581.202930:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.203119:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770208768 00000100:00100000:2.0:1788836581.203131:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770208768 00000100:00100000:2.0:1788836581.203195:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:2.0:1788836581.203226:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:11263:x1875730770208768:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:2.0:1788836581.203518:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.203537:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.203557:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836581.203617:0:10333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788836581.203641:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e544268 reply state 0000000048686897 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.203664:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.203673:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836581.203676:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836581.203679:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836581.203769:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:11263:x1875730770208768:12345-192.168.201.38@tcp:36:bash.0 Request processed in 545us (849us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788836581.203776:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000020:00080000:2.0:1788836581.203781:0:10333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788836581.209759:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.209858:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770208896 00000100:00100000:1.0:1788836581.209869:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770208896 00000100:00100000:1.0:1788836581.209931:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788836581.209942:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:11263:x1875730770208896:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836581.209967:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836581.209988:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65544cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa331 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.210129:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.210146:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 53 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.210154:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.210193:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 53 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.210208:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 53 pid: 12185 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836581.210240:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782883584:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836581.210358:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836581.213175:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.213267:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770209024 00000100:00100000:2.0:1788836581.213275:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770209024 00010000:00010000:2.0:1788836581.213312:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 54 pid: 12185 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836581.213351:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:2.0:1788836581.213381:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:2394:x1875730770209024:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836581.213395:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836581.213401:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 54 pid: 12185 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.213415:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 54 pid: 12185 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.213443:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836581.213449:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.213461:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.213469:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.213486:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836581.213532:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:2394:x1875730770209024:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 153us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.213539:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00010000:00010000:1.0:1788836581.214714:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65544b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa32a expref: 53 pid: 12185 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836581.214737:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43922300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782883584:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836581.214757:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.214768:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.214774:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836581.214844:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788836581.214849:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836581.214876:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.214911:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65544cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa331 expref: 53 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.214925:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa331 expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836581.214934:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836581.214947:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836581.214957:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992c00, rc 0) 00000100:00100000:1.0:1788836581.215050:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:11263:x1875730770208896:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5069us (5262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836581.215060:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1788836581.217213:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.217335:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770209280 00000100:00100000:1.0:1788836581.217345:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770209280 00000100:00100000:1.0:1788836581.217401:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1788836581.217412:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:11263:x1875730770209280:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:1.0:1788836581.217715:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11263:x1875730770209280:12345-192.168.201.38@tcp:35:bash.0 Request processed in 304us (510us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788836581.217724:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836581.292941:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836581.293037:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770209536 00000100:00100000:3.0:1788836581.293046:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770209536 00000100:00100000:3.0:1788836581.293116:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788836581.293126:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11273:x1875730770209536:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836581.293150:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836581.293169:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a65544db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa338 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836581.293275:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788836581.293375:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a65544db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa338 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836581.293390:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:3.0:1788836581.293394:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836581.293399:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47a00/0xf7b38383a65544db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa338 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836581.293416:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47a00, rc 0) 00000100:00100000:3.0:1788836581.293723:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11273:x1875730770209536:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 597us (790us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788836581.293732:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1788836581.297180:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.297304:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770209664 00000100:00100000:0.0:1788836581.297316:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770209664 00000100:00100000:0.0:1788836581.297410:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788836581.297480:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11273:x1875730770209664:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788836581.297639:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297668:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297681:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297693:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297700:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297705:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297788:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297798:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297804:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836581.297874:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297890:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297896:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297903:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297909:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.297914:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297923:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297935:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836581.297938:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.297943:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297950:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65544e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297964:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297969:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297982:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297986:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.297990:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.297995:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298003:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:0.0:1788836581.298006:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.298009:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298258:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65544f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298270:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298276:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298281:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298287:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.298289:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298307:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298317:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.298319:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.298323:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.298330:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836581.298511:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11273:x1875730770209664:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1091us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836581.298521:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788836581.301740:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.301812:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770209920 00000100:00100000:1.0:1788836581.301823:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770209920 00000100:00100000:1.0:1788836581.301911:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788836581.301922:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11273:x1875730770209920:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836581.302208:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:11273:x1875730770209920:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 286us (476us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788836581.302215:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788836581.316711:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.316750:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.316787:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.316846:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.316874:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.316904:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210176 00000100:00100000:1.0:1788836581.316914:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210176 00000100:00100000:1.0:1788836581.316973:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210432 00000100:00100000:1.0:1788836581.316976:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210432 00000100:00100000:1.0:1788836581.316993:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210560 00000100:00100000:1.0:1788836581.316995:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210560 00000100:00100000:1.0:1788836581.317041:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:1.0:1788836581.317052:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770210176:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836581.317168:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210304 00000100:00100000:2.0:1788836581.317173:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210304 00000100:00100000:2.0:1788836581.317205:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:2.0:1788836581.317212:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770210304:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836581.317290:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770210304:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.317298:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:2.0:1788836581.317437:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 298 00000100:00100000:2.0:1788836581.317446:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770210432:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836581.317478:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770210432:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.317484:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 298 00000100:00100000:2.0:1788836581.317501:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:2.0:1788836581.317508:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770210560:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836581.317535:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770210560:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.317552:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:1.0:1788836581.318640:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770210176:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 1580us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836581.318660:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:3.0:1788836581.318911:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210048 00000100:00100000:3.0:1788836581.318935:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210048 00000100:00100000:3.0:1788836581.318992:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 385 00000100:00100000:3.0:1788836581.319000:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770210048:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836581.319060:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770210048:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 61us (2273us total) trans 0 rc 0/0 00000100:00080000:0.0:1788836581.319182:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836581.319188:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836581.319191:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836581.319220:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 385 00000100:00100000:2.0:1788836581.337110:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.337256:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210816 00000100:00100000:0.0:1788836581.337265:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210816 00000100:00100000:0.0:1788836581.337329:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:0.0:1788836581.337339:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:11277:x1875730770210816:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836581.337366:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.337390:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa33f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337621:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337669:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337680:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337692:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337699:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337706:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337822:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337832:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337839:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.337848:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788836581.337930:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337939:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337945:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337958:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.337963:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337970:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337982:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836581.337985:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.337990:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.337997:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338221:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338229:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338236:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338242:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.338245:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338252:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338271:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:0.0:1788836581.338274:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.338277:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338283:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655450c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338323:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65544fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa33f expref: 58 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338338:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa33f expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.338346:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.338348:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836581.338350:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836581.338596:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:11277:x1875730770210816:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1258us (1496us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788836581.338605:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788836581.342406:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.342751:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836581.343180:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770211072 00000100:00100000:3.0:1788836581.343190:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770211072 00000100:00100000:3.0:1788836581.343259:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1788836581.343269:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:2394:x1875730770211072:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836581.343286:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836581.343311:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a6554513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa33f expref: 57 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836581.343330:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836581.343335:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836581.343395:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:2394:x1875730770211072:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 127us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836581.343402:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788836581.344659:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770210944 00000100:00100000:0.0:1788836581.344669:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770210944 00000100:00100000:0.0:1788836581.344723:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:0.0:1788836581.344733:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:11277:x1875730770210944:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788836581.344797:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344814:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344839:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344873:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344880:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344886:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344892:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.344896:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344904:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344914:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.344918:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836581.344923:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.344930:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554521 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836581.345102:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:11277:x1875730770210944:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 369us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836581.345110:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1788836581.348270:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836581.348371:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770211328 00000100:00100000:3.0:1788836581.348385:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770211328 00000100:00100000:3.0:1788836581.348522:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1788836581.348654:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:11277:x1875730770211328:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836581.348942:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:11277:x1875730770211328:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 409us (687us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788836581.348950:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788836581.500614:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.501223:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770211584 00000100:00100000:0.0:1788836581.501237:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770211584 00000100:00100000:0.0:1788836581.501313:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:0.0:1788836581.501324:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:11295:x1875730770211584:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788836581.501353:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.501376:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554528 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa346 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.501504:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655452f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.501519:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655452f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.501530:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655452f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.501552:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788836581.501676:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554528 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa346 expref: 60 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.501698:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655452f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa346 expref: 59 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.501707:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.501711:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788836581.501714:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173600, rc 0) 00000100:00100000:0.0:1788836581.502258:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:11295:x1875730770211584:12345-192.168.201.38@tcp:101:cat.0 Request processed in 932us (1650us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788836581.502286:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:2.0:1788836581.546436:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.546651:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770211712 00000100:00100000:0.0:1788836581.546665:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770211712 00000100:00100000:0.0:1788836581.546760:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:0.0:1788836581.546774:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:11296:x1875730770211712:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836581.546808:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.546834:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655453d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa34d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.546937:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.546954:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.546966:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.547073:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788836581.547077:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836581.547099:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.547127:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a655453d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa34d expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.547146:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa34d expref: 60 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.547174:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836581.547177:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836581.547180:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:0.0:1788836581.547235:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11296:x1875730770211712:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 464us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836581.547243:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1788836581.551127:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836581.551299:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212096 00000100:00100000:1.0:1788836581.551310:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212096 00000100:00100000:1.0:1788836581.551373:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788836581.551385:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11296:x1875730770212096:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836581.551711:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11296:x1875730770212096:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 327us (594us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788836581.551720:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788836581.554724:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.554878:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212224 00000100:00100000:2.0:1788836581.554888:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212224 00000100:00100000:2.0:1788836581.554958:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1788836581.554968:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11296:x1875730770212224:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:2.0:1788836581.554985:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836581.555049:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65544d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa331 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.555263:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655452f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa346 expref: 60 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.555278:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65543d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2eb expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.555290:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836581.555295:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836581.555355:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11296:x1875730770212224:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 387us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.555363:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788836581.558238:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836581.558321:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212352 00000100:00100000:2.0:1788836581.558333:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212352 00000100:00100000:2.0:1788836581.558396:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:2.0:1788836581.558405:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11296:x1875730770212352:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:2.0:1788836581.558568:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.558587:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836581.558598:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836581.558845:0:10681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836581.558985:0:10681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788836581.559383:0:10681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788836581.559678:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11296:x1875730770212352:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 1271us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836581.559688:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:3.0:1788836581.582366:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836581.582479:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212480 00000100:00100000:0.0:1788836581.582489:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212480 00000100:00100000:0.0:1788836581.582556:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:0.0:1788836581.582566:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11298:x1875730770212480:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836581.582587:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836581.582608:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554552 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa354 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582681:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582697:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582708:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582720:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582728:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582750:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582822:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582831:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582838:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836581.582880:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788836581.582885:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836581.582905:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582917:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582925:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582931:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582938:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582943:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.582948:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582961:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582976:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836581.582978:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.582983:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.582989:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554559 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583003:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583008:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583057:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583062:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836581.583073:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583080:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583088:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:0.0:1788836581.583091:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836581.583094:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583109:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583135:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554552 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583148:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836581.583155:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836581.583158:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836581.583160:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7800, rc 0) 00000100:00100000:0.0:1788836581.583213:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:11298:x1875730770212480:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 648us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836581.583220:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00010000:00010000:2.0:1788836581.762796:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836582.142430:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836582.142440:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836582.142478:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788836582.142486:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836582.142640:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782883712:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836582.142733:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42789600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836582.143162:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836582.143172:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782883840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836582.143214:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.143255:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782883840 00000100:00100000:1.0:1788836582.143262:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782883840 00000100:00100000:1.0:1788836582.143303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836582.143312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782883840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836582.143346:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:1.0:1788836582.143392:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782883840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836582.143399:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836582.143442:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782883840:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788836582.148224:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1788836582.148257:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788836582.148314:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788836582.148325:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adf46111900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788836582.148330:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ade4108f200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adf46111d80 00000020:00080000:3.0:1788836582.148333:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ade42b0d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade43983400 00000100:00100000:0.0:1788836582.149246:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836582.149271:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782883968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788836582.149346:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836582.149397:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782883968 00000100:00100000:0.0:1788836582.149405:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782883968 00000100:00100000:0.0:1788836582.149462:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836582.149471:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782883968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788836582.149498:0:8498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788836582.149542:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f7ae3, atime: 0x6a9f7ae3, ctime: 0x6a9f7ae3, blocks: 0x8 00010000:00010000:0.0:1788836582.149551:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149584:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788836582.149589:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836582.149595:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149611:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149622:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149639:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149658:0:8498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836582.149801:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782883968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 331us (455us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788836582.149809:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788836582.149835:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836582.149841:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836582.149846:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade4455aa00/2, rc 0, transno 4294967302 00010000:00010000:0.0:1788836582.149849:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc0edb420) 00000100:00100000:3.0:1788836582.149851:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782883968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788836582.149853:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149873:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149889:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149897:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd771c7/0xf7b38383a655456e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.149915:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836582.149918:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836582.149920:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836582.155078:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155094:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155103:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155109:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155114:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155123:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155142:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adf785f7600) 00010000:00010000:1.0:1788836582.155145:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155151:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155170:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46800/0xf7b38383a655430d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155190:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155196:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155202:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155208:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155211:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155217:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155226:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836582.155229:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155232:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155238:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f47600/0xf7b38383a6554314 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155253:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155260:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155272:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155278:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155280:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155287:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155296:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf439d0f00) 00010000:00010000:1.0:1788836582.155298:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155301:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155307:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554353 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155324:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155331:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155338:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155343:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155346:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155362:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155371:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836582.155374:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155377:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155382:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655445d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155394:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155401:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155408:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155413:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155416:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155421:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155446:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836582.155449:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155452:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155467:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554480 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155479:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155485:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155491:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155495:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.155498:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155504:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155512:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836582.155514:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836582.155517:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.155533:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65544c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788836582.155553:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788836582.155761:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788836582.164341:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782883712:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836582.165306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.166768:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212608 00000100:00100000:0.0:1788836582.166781:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212608 00000100:00100000:0.0:1788836582.166855:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:0.0:1788836582.166865:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11309:x1875730770212608:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836582.166899:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836582.167031:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11309:x1875730770212608:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 167us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.167039:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00080000:3.0:1788836582.167267:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836582.184951:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.185579:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212736 00000100:00100000:0.0:1788836582.186195:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212736 00000100:00100000:0.0:1788836582.186272:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:0.0:1788836582.186282:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11309:x1875730770212736:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.186375:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186393:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186405:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186479:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186487:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186493:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186519:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186539:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.186546:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836582.187780:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788836582.187790:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836582.187808:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187825:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187840:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187847:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187854:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.187859:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187868:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187882:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:0.0:1788836582.187886:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.187890:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187896:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554575 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187910:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187916:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187922:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187927:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.187937:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187944:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187952:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8ade43819900) 00010000:00010000:0.0:1788836582.187955:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.187958:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187963:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655457c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187979:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187985:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187990:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.187994:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.187997:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.188002:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.188025:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836582.188028:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.188037:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.188043:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.188135:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11309:x1875730770212736:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 1851us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.188144:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:0.0:1788836582.197335:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.197677:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770212992 00000100:00100000:3.0:1788836582.197689:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770212992 00000100:00100000:3.0:1788836582.198492:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1788836582.198504:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:11309:x1875730770212992:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836582.198535:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836582.198556:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a655458a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa35b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198685:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198701:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198712:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836582.198732:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788836582.198816:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198824:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198831:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198836:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836582.198840:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198848:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198861:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836582.198864:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836582.198868:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198875:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198916:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a655458a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa35b expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198927:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:3.0:1788836582.198929:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836582.198939:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a655458a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa35b expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.198948:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701c00, rc 0) 00000100:00100000:3.0:1788836582.199040:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770212992:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 538us (1717us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788836582.199047:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:0.0:1788836582.215692:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.215881:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770213120 00000100:00100000:1.0:1788836582.215892:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770213120 00000100:00100000:1.0:1788836582.215959:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:1.0:1788836582.215967:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770213120:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836582.216001:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836582.216243:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770213120:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 275us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836582.216250:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1788836582.219148:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.219569:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770213376 00000100:00100000:1.0:1788836582.219580:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770213376 00000100:00100000:1.0:1788836582.219664:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:1.0:1788836582.219675:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770213376:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836582.219698:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836582.219701:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836582.219728:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa34d expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.219749:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836582.219754:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836582.219767:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a655459f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa362 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836582.220202:0:10681:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788836582.220343:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65545a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.220357:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65545a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.220368:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65545a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.220441:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a655459f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa362 expref: 15 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.220457:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65545a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa362 expref: 14 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.220464:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adf7a535700) 00010000:00010000:1.0:1788836582.220467:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836582.220470:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993000, rc 0) 00000100:00100000:1.0:1788836582.220533:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770213376:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 860us (1394us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788836582.220541:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:3.0:1788836582.228215:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.232167:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770213632 00000100:00100000:0.0:1788836582.232183:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770213632 00000100:00100000:0.0:1788836582.232971:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:0.0:1788836582.232985:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770213632:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.233081:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836582.233109:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a65545a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa362 expref: 14 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233126:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adf7a535700) 00010000:00010000:0.0:1788836582.233136:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836582.233158:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233172:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233182:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233254:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233263:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233270:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233318:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233326:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233333:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233340:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.233344:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233352:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233361:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836582.233364:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.233368:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233374:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65545b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233391:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233397:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233403:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233408:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.233411:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233417:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233439:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x34c3d1de (ffff8ade43819900) 00010000:00010000:0.0:1788836582.233441:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.233444:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.233450:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a65545bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x34c3d1de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.233555:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770213632:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 574us (6551us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836582.233562:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:2.0:1788836582.242329:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.242400:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770213760 00000100:00100000:0.0:1788836582.242411:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770213760 00000100:00100000:0.0:1788836582.242478:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:0.0:1788836582.242500:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11309:x1875730770213760:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.242531:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836582.242557:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa369 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242594:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242610:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242621:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242771:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242790:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.242799:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836582.242801:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836582.242804:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836582.242863:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770213760:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 366us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.242870:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:3.0:1788836582.245739:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.245913:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214016 00000100:00100000:0.0:1788836582.245923:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214016 00000100:00100000:0.0:1788836582.245989:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1788836582.246039:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770214016:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.246130:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.246147:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.246157:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836582.246330:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788836582.246341:0:10333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366152328509ns, next at 367152324322ns, rc = 0 00000004:00010000:0.0:1788836582.246394:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a11c302 reply state 00000000567bd948 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.246409:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.246418:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836582.246421:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788836582.246425:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836582.246522:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11309:x1875730770214016:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 509us (794us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788836582.246529:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1788836582.258409:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.258447:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214144 00000100:00100000:0.0:1788836582.258457:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214144 00000100:00100000:0.0:1788836582.258511:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1788836582.258521:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11309:x1875730770214144:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.258567:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836582.258589:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa370 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.258657:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.258672:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.258694:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836582.258697:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836582.258702:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00100000:0.0:1788836582.258769:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11309:x1875730770214144:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 249us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.258777:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:2.0:1788836582.262879:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.266914:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214272 00000100:00100000:0.0:1788836582.266932:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214272 00000100:00100000:0.0:1788836582.266989:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1788836582.266998:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875730770214272:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788836582.270854:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp t0 exp 0000000000000000 cur 366 last 0 00000020:00000080:0.0:1788836582.270906:0:8408:0:(genops.c:1385:class_connect()) connect: client 9b8fbf20-a55f-40bb-87b6-19e878cca24b, cookie 0xf7b38383a65545de 00002000:00100000:0.0:1788836582.270920:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b8fbf20-a55f-40bb-87b6-19e878cca24b/ffff8adf506ed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836582.270942:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788836582.271039:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836582.271085:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8adf506ec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836582.271180:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2393:x1875730770214272:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 Request processed in 4179us (8310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.271190:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1788836582.276965:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.277095:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214400 00000100:00100000:3.0:1788836582.277106:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214400 00000100:00100000:3.0:1788836582.277181:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1788836582.277193:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:0:x1875730770214400:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788836582.277479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788836582.285755:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788836582.285771:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000100:00100000:3.0:1788836582.285949:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:0:x1875730770214400:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 8752us (8989us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788836582.285960:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1788836582.288241:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.288312:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214656 00000100:00100000:3.0:1788836582.288322:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214656 00000100:00100000:3.0:1788836582.288378:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836582.288387:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11309:x1875730770214656:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836582.288593:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11309:x1875730770214656:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 206us (360us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788836582.288601:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788836582.290432:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.290498:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770214912 00000100:00100000:1.0:1788836582.290507:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770214912 00000100:00100000:1.0:1788836582.290569:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:1.0:1788836582.290578:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11309:x1875730770214912:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836582.290680:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11309:x1875730770214912:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836582.290689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:3.0:1788836582.303558:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.303601:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215040 00000100:00100000:3.0:1788836582.303621:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215040 00000100:00100000:3.0:1788836582.303693:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1788836582.303703:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11309:x1875730770215040:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836582.303724:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836582.303744:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a65545e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa377 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303830:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303844:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303856:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836582.303904:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836582.303924:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303954:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a65545e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa377 expref: 20 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303975:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa377 expref: 19 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.303985:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:3.0:1788836582.303988:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788836582.303992:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836582.306269:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11309:x1875730770215040:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 2557us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.306288:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1788836582.308996:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000040:00080000:0.0:1788836582.310557:0:14198:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836582.310564:0:14198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836582.310589:0:14198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788836582.310595:0:14198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836582.310915:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215168 00000100:00100000:2.0:1788836582.310924:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215168 00000100:00100000:2.0:1788836582.310983:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788836582.310993:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770215168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836582.311026:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836582.311046:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa37e expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836582.311081:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7ae6, blocks: 0x0 00010000:00010000:2.0:1788836582.311099:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1788836582.311103:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836582.311113:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.311131:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.311143:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030800, rc 0) 00000100:00100000:2.0:1788836582.312481:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770215168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1480us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836582.312491:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1788836582.323223:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.323649:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215424 00000100:00100000:3.0:1788836582.323659:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215424 00000100:00100000:3.0:1788836582.323716:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:3.0:1788836582.323726:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11309:x1875730770215424:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788836582.324986:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11309:x1875730770215424:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 1256us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.324998:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:0.0:1788836582.344266:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.344313:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215552 00000100:00100000:0.0:1788836582.344325:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215552 00000100:00100000:0.0:1788836582.344386:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1788836582.344397:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:11309:x1875730770215552:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.344418:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836582.344447:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa385 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.344481:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.344490:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836582.344506:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836582.344512:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.344548:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.344564:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 7 pid: 8407 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.344579:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782884096:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836582.344676:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836582.350133:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.350258:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215680 00000100:00100000:3.0:1788836582.350268:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215680 00010000:00010000:3.0:1788836582.350308:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 8 pid: 8407 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.350353:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788836582.350364:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770215680:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836582.350382:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836582.350404:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 8 pid: 8407 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.350418:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 8 pid: 8407 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.350455:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836582.350460:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836582.350485:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.350497:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.350551:0:13174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.350567:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13174:1875730782884224:192.168.201.38@tcp:105: 00000100:00100000:3.0:1788836582.350664:0:13174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42aaa900 going to sleep for 11 seconds 00010000:00010000:0.0:1788836582.350855:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9152b13/0xf7b38383a65545f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa37e expref: 8 pid: 8407 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.350871:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782884096:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836582.350896:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.350908:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836582.350939:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11309:x1875730770215552:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 6543us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.350947:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1788836582.367312:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13174:1875730782884224:192.168.201.38@tcp:105: 00010000:00010000:3.0:1788836582.367339:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836582.367399:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770215680:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 17036us (17275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.367410:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788836582.367930:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.370101:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215808 00000100:00100000:0.0:1788836582.370117:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215808 00002000:00100000:0.0:1788836582.370174:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ade445e2a00 x1875730770215808/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:748/0 lens 504/0 e 0 to 0 dl 1788836593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836582.370198:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade445e2a00 with x1875730770215808 ext(0->8) 00002000:00010000:0.0:1788836582.370206:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade445e2a00 00000100:00100000:0.0:1788836582.370233:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788836582.370243:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770215808:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788836582.375240:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770215808:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 4986us (7300us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788836582.375255:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:1.0:1788836582.375268:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ade445e2a00 x1875730770215808/t4294967303(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:748/0 lens 504/448 e 0 to 0 dl 1788836593 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836582.375291:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade445e2a00 with x1875730770215808 ext(0->8) 00002000:00010000:1.0:1788836582.375297:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade445e2a00 00000100:00100000:1.0:1788836582.378829:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.379159:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770215936 00000100:00100000:3.0:1788836582.379172:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770215936 00000100:00100000:3.0:1788836582.379245:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:3.0:1788836582.379259:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11309:x1875730770215936:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788836582.391762:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788836582.391782:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788836582.391800:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788836582.391907:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788836582.391920:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788836582.392091:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:11309:x1875730770215936:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 12830us (13264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.392103:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:3.0:1788836582.392142:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782884352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836582.392191:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836582.392665:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392679:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392687:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392697:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.392702:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392711:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392727:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836582.392730:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836582.392735:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.392741:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65545d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.394177:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782884352 00000100:00100000:3.0:1788836582.394192:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782884352 00000100:00100000:3.0:1788836582.394274:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836582.394284:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782884352:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788836582.394527:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788836582.394618:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788836582.394622:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788836582 00002000:00010000:3.0:1788836582.394624:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788836582.394635:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788836582 -> 1788836582 00002000:00010000:3.0:1788836582.394638:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788836582.394728:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782884352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 445us (2535us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788836582.394736:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788836582.395082:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade445e2d80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788836582.395089:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782884352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788836582.399230:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.401697:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216064 00000100:00100000:0.0:1788836582.401712:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216064 00000100:00100000:0.0:1788836582.401766:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788836582.401776:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770216064:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788836582.413689:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788836582.413705:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788836582.413838:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770216064:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 12057us (14611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.413849:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1788836582.419956:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.420063:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216320 00000100:00100000:1.0:1788836582.420075:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216320 00000100:00100000:1.0:1788836582.420132:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:1.0:1788836582.420143:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770216320:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836582.420200:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836582.420229:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a65545ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa377 expref: 14 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.420244:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:1.0:1788836582.420249:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836582.420282:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.420295:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.420304:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836582.421937:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8496e92 reply state 000000005410ef33 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.421961:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.421978:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:1.0:1788836582.421981:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836582.421985:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836582.422128:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:11309:x1875730770216320:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1982us (2178us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788836582.422137:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:1.0:1788836582.427442:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.427515:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216448 00000100:00100000:3.0:1788836582.427536:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216448 00000100:00100000:3.0:1788836582.427594:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1788836582.427604:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770216448:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788836582.427776:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788836582.427780:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788836582 -> 1788836581 00002000:00010000:3.0:1788836582.427782:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788836579 00002000:00010000:3.0:1788836582.427784:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788836582 -> 1788836581 00002000:00010000:3.0:1788836582.427786:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788836582.427853:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770216448:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 250us (431us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788836582.427862:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1788836582.437556:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.437710:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216704 00000100:00100000:1.0:1788836582.437721:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216704 00000100:00100000:1.0:1788836582.437785:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:1.0:1788836582.437796:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:11309:x1875730770216704:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788836582.437868:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.437886:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.437896:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.437935:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.437948:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 15 pid: 6490 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.437962:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782884480:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836582.438100:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836582.441614:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.442199:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216832 00000100:00100000:3.0:1788836582.442210:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216832 00010000:00010000:3.0:1788836582.442254:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 16 pid: 6490 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.442292:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:3.0:1788836582.442302:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:2394:x1875730770216832:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836582.442317:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836582.442324:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 16 pid: 6490 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.442338:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 16 pid: 6490 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.442361:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:3.0:1788836582.442366:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.442387:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.442395:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.442414:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836582.442475:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:2394:x1875730770216832:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 174us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.442482:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00010000:00010000:3.0:1788836582.443451:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65545c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa369 expref: 15 pid: 6490 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.443472:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782884480:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836582.443492:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.443503:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.443509:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444254:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444264:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444272:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444289:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836582.444294:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444302:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444317:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:3.0:1788836582.444320:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788836582.444325:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.444331:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554608 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.444579:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770216704:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 6783us (7034us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788836582.444590:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:1.0:1788836582.452337:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.455189:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770216960 00000100:00100000:0.0:1788836582.455202:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770216960 00000100:00100000:0.0:1788836582.455259:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:0.0:1788836582.455269:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770216960:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788836582.455315:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.455336:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.455346:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836582.455350:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836582.455355:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.455395:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.455411:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 7 pid: 8405 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.455439:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782884608:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836582.455537:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf493be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836582.458807:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836582.459789:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782884608:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836582.459821:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.459853:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217088 00000100:00100000:1.0:1788836582.459860:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217088 00010000:00010000:1.0:1788836582.459892:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.459938:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:1.0:1788836582.459948:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770217088:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836582.459964:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836582.459986:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.460001:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.460047:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cec06db/0xf7b38383a65545fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa385 expref: 8 pid: 8405 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.460282:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836582.460286:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836582.460305:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.460316:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.460349:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836582.460473:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460483:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460504:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460512:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460529:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460536:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836582.460541:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460550:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460576:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.460585:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdd771c7/0xf7b38383a655460f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.460717:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770217088:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 769us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836582.460727:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1788836582.461492:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770216960:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 6220us (9159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.461502:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:3.0:1788836582.467845:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.467876:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217344 00000100:00100000:3.0:1788836582.467887:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217344 00000100:00100000:3.0:1788836582.467955:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:3.0:1788836582.467967:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11309:x1875730770217344:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836582.468077:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.468095:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.468112:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.468147:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.468161:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 14 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.468177:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782884736:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836582.468252:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42aaa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836582.474279:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.474365:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782884736:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836582.474391:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.474418:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217472 00000100:00100000:3.0:1788836582.474498:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217472 00010000:00010000:3.0:1788836582.474600:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.474675:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:3.0:1788836582.474686:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:2394:x1875730770217472:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836582.474702:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836582.474709:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474734:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474757:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf77f46600/0xf7b38383a6554456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa30e expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474773:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836582.474778:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474789:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474797:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.474818:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836582.474868:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2394:x1875730770217472:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 183us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.474876:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00010000:00010000:2.0:1788836582.476156:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.476172:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.476374:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.476391:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.476401:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.478179:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836582.478202:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 14 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836582.478218:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782884864:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836582.478361:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836582.487852:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836582.487884:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217600 00000100:00100000:0.0:1788836582.487895:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217600 00010000:00010000:0.0:1788836582.487939:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.487980:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1788836582.487990:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:2395:x1875730770217600:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836582.488005:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836582.488040:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.488057:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 15 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.488079:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836582.488096:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.488106:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.488114:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.488135:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836582.488182:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:2395:x1875730770217600:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 193us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.488190:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00010000:00010000:3.0:1788836582.489491:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65545d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa370 expref: 14 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.489511:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782884864:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836582.489545:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.489554:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.489570:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836582.489692:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788836582.489802:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788836582.489836:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788836582.489914:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1875730782884992:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788836582.489969:0:10681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836582.489994:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf497c69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836582.490333:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782884992 00000100:00100000:0.0:1788836582.490342:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782884992 00000100:00100000:0.0:1788836582.490407:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788836582.490417:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10681:x1875730782884992:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788836582.490508:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10681:x1875730782884992:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.490525:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788836582.490677:0:10681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788836582.490684:0:10681:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade445e2d80, transno 4294967304 00000100:00100000:2.0:1788836582.490703:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1875730782884992:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788836582.490819:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788836582.490864:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1875730782885120:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788836582.490896:0:10681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836582.492174:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836582.494289:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885120 00000100:00100000:0.0:1788836582.494300:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885120 00000100:00100000:0.0:1788836582.494350:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788836582.494357:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10681:x1875730782885120:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788836582.494545:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10681:x1875730782885120:12345-0@lo:1000:mdt00_004.0 Request processed in 188us (3648us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788836582.494550:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788836582.494986:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1875730782885120:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788836582.495253:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495264:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495272:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495278:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.495283:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495292:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495309:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:1.0:1788836582.495312:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836582.495317:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495330:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a655461d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495373:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495380:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495385:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495390:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836582.495394:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495399:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495407:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836582.495410:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836582.495413:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495418:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655454b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495451:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495467:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495482:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495531:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836582.495547:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 17 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.495560:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782885248:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836582.495653:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836582.499121:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.499206:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782885248:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836582.499234:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836582.504307:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217728 00000100:00100000:1.0:1788836582.504329:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217728 00010000:00010000:1.0:1788836582.504383:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 18 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836582.504535:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836582.504549:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2394:x1875730770217728:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836582.504565:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836582.504573:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 18 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504587:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 18 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504611:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554567 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa354 expref: 18 pid: 6492 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504636:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836582.504650:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504662:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504670:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.504708:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836582.504768:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:2394:x1875730770217728:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 223us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.504776:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00010000:00010000:0.0:1788836582.504975:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.504984:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.504998:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505005:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505041:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505048:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.505056:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505063:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505073:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836582.505076:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836582.505080:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505087:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554624 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505097:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505113:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505118:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505122:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836582.505125:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505130:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505138:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836582.505140:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836582.505143:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836582.505148:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554616 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836582.505305:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11309:x1875730770217344:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 37338us (37470us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788836582.505314:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000020:00080000:0.0:1788836582.505318:0:10681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788836582.508175:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836582.508184:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836582.508206:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788836582.508213:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836582.511816:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836582.514950:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770217984 00000100:00100000:3.0:1788836582.514965:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770217984 00000100:00100000:3.0:1788836582.515059:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1788836582.515070:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11309:x1875730770217984:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788836582.515342:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788836582.515377:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788836582.515412:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515427:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515438:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515455:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515462:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515468:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515486:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788836582.515580:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11309:x1875730770217984:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 511us (3771us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788836582.515588:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000020:00080000:3.0:1788836582.515593:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836582.515613:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836582.515619:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515638:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836582.515642:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515651:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515664:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:3.0:1788836582.515667:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836582.515672:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515688:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655462b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836582.515699:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836582.515701:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836582.515703:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836582.654734:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836582.654758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782885376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836582.654891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.655127:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782885504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.655168:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.655218:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782886016:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.655242:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.655264:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782886528:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.655283:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.655305:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836582.655311:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782885632:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.655333:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.655360:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782886144:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.655807:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782885760:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.655877:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885504 00000100:00100000:0.0:1788836582.655885:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885504 00000100:00100000:0.0:1788836582.656079:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788836582.656090:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782885504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.656138:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782885504:12345-0@lo:400:kworker.0 Request processed in 50us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.656144:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788836582.656192:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886016 00000100:00100000:0.0:1788836582.656196:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886016 00000100:00100000:0.0:1788836582.656229:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886528 00000100:00100000:0.0:1788836582.656233:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886528 00000100:00100000:0.0:1788836582.656249:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885632 00000100:00100000:0.0:1788836582.656251:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885632 00000100:00100000:0.0:1788836582.656267:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788836582.656274:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.656307:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782886016:12345-0@lo:400:kworker.0 Request processed in 33us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.656313:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788836582.656324:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788836582.656330:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.656356:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782886528:12345-0@lo:400:kworker.0 Request processed in 26us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.656362:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788836582.656373:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788836582.656378:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782885632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.656402:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782885632:12345-0@lo:400:kworker.0 Request processed in 24us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.656414:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1788836582.656430:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836582.656434:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836582.656606:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.656674:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5071d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782886656:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656703:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.656737:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782885504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656751:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782886016:0@lo:400:kworker.0 00010000:00080000:1.0:1788836582.656763:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf5076c380 x1875730782886528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836582.656772:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782886528:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656805:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782885632:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656827:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886656 00000100:00100000:1.0:1788836582.656831:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886656 00000100:00100000:1.0:1788836582.656867:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836582.656874:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782886656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656910:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782886656:12345-0@lo:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836582.656916:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788836582.656932:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836582.656942:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.656960:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782886272:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.656981:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.657001:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788836582.657007:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782885888:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.657049:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.657079:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782886400:0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.657102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836582.657128:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886272 00000100:00100000:1.0:1788836582.657132:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886272 00000100:00100000:1.0:1788836582.657157:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788836582.657654:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886144 00000100:00100000:3.0:1788836582.657659:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886144 00000100:00100000:3.0:1788836582.657691:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885760 00000100:00100000:3.0:1788836582.657695:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885760 00000100:00100000:3.0:1788836582.657706:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886400 00000100:00100000:3.0:1788836582.657708:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886400 00000100:00100000:3.0:1788836582.657717:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788836582.657722:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782886144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836582.657753:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782886144:12345-0@lo:400:kworker.0 Request processed in 32us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.657757:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788836582.657765:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788836582.657768:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782885760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836582.657798:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782885760:12345-0@lo:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.657801:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788836582.657808:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788836582.657811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782886400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836582.657825:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782886400:12345-0@lo:400:kworker.0 Request processed in 14us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836582.657828:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788836582.657872:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782886272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836582.657903:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782886272:12345-0@lo:400:kworker.0 Request processed in 32us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.657971:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885888 00000100:00100000:0.0:1788836582.657974:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885888 00000100:00100000:0.0:1788836582.657993:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788836582.657997:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.658038:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782885888:12345-0@lo:400:kworker.0 Request processed in 40us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.658041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:0.0:1788836582.658067:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf5076ca80 x1875730782886144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836582.658074:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782886144:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.658081:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5071d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782886656:0@lo:400:kworker.0 00000100:00080000:0.0:1788836582.658104:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836582.658106:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836582.658116:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782885888:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.658122:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782886400:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.658127:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782885760:0@lo:400:kworker.0 00000100:00100000:0.0:1788836582.658132:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782886272:0@lo:400:kworker.0 00000100:00100000:2.0:1788836582.659646:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782885376 00000100:00100000:2.0:1788836582.659659:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782885376 00000100:00100000:0.0:1788836582.660217:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788836582.660227:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782885376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836582.660252:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788836582.660340:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782885376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (5449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836582.660347:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788836582.660395:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782885376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836582.660956:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1788836582.785116:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836583.166291:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836583.166316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5071d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782886784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836583.166391:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836583.166570:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782886784 00000100:00100000:2.0:1788836583.166579:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782886784 00000100:00100000:2.0:1788836583.166664:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788836583.166674:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782886784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836583.166699:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788836583.166755:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782886784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836583.166762:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788836583.166883:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5071d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782886784:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836583.812118:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836584.132302:0:14249:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836584.132312:0:14249:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836584.132338:0:14249:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788836584.132348:0:14249:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836584.293752:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836584.295655:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770218240 00000100:00100000:2.0:1788836584.295672:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770218240 00000100:00100000:2.0:1788836584.295746:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1788836584.295757:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:11327:x1875730770218240:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836584.295786:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836584.295810:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa38c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.295924:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554639 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.295940:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554639 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.295964:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554639 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836584.295991:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788836584.296746:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa38c expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.296766:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554639 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa38c expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.296776:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836584.296778:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836584.296782:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031800, rc 0) 00000100:00100000:2.0:1788836584.296863:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11327:x1875730770218240:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1107us (3120us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788836584.296870:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00080000:3.0:1788836584.299827:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836584.301321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.301383:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770218368 00000100:00100000:3.0:1788836584.301393:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770218368 00000100:00100000:3.0:1788836584.301442:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:3.0:1788836584.301461:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11327:x1875730770218368:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788836584.301538:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301555:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301566:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301581:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301588:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301605:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301687:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301695:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301709:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836584.301751:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301763:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301770:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301777:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301782:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836584.301786:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301794:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301806:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:3.0:1788836584.301809:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836584.301813:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301819:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301829:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301839:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301845:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301850:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836584.301854:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301861:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301868:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf77296e00) 00010000:00010000:3.0:1788836584.301870:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836584.301872:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301878:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655464e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301890:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301896:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301901:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301906:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836584.301912:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301919:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301926:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296800) 00010000:00010000:3.0:1788836584.301927:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836584.301930:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.301935:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554655 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836584.302038:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11327:x1875730770218368:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 553us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836584.302045:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:1.0:1788836584.339842:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.339904:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770218624 00000100:00100000:3.0:1788836584.339912:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770218624 00000100:00100000:3.0:1788836584.339965:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:3.0:1788836584.339973:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11330:x1875730770218624:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836584.339990:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836584.340007:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a655465c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa393 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340094:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340105:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340127:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340137:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340142:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340146:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340233:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340238:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340242:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836584.340249:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788836584.340309:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340313:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340318:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340321:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836584.340329:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340335:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340344:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:3.0:1788836584.340346:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836584.340349:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340353:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554663 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340362:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340366:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340369:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340372:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836584.340373:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340376:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340380:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf77296800) 00010000:00010000:3.0:1788836584.340381:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836584.340386:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340390:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655466a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340418:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a655465c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340832:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.340837:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:3.0:1788836584.340839:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836584.340841:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701800, rc 0) 00000100:00100000:3.0:1788836584.340896:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11330:x1875730770218624:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 923us (1066us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788836584.340902:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788836584.344532:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836584.344725:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770218752 00000100:00100000:1.0:1788836584.344734:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770218752 00000100:00100000:1.0:1788836584.344781:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:1.0:1788836584.344788:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11330:x1875730770218752:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788836584.344849:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344867:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344878:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344915:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344929:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344935:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344940:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836584.344944:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344962:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344976:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:1.0:1788836584.344979:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836584.344984:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.344989:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a655467f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836584.345104:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11330:x1875730770218752:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 315us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836584.345112:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:1.0:1788836584.347375:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.347444:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219008 00000100:00100000:3.0:1788836584.347523:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219008 00000100:00100000:3.0:1788836584.347604:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836584.347619:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11330:x1875730770219008:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836584.347802:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:11330:x1875730770219008:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 189us (433us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788836584.347810:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788836584.412226:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.412324:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219264 00000100:00100000:3.0:1788836584.412335:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219264 00000100:00100000:3.0:1788836584.412402:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:3.0:1788836584.412413:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:10850:x1875730770219264:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836584.412454:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836584.412476:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554686 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa39a expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.412589:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.412615:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.412625:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.412659:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.412673:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 24 pid: 6490 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836584.412686:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782886912:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836584.412970:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836584.417240:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782886912:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836584.417284:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836584.417702:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.417782:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219392 00000100:00100000:0.0:1788836584.417798:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219392 00010000:00010000:0.0:1788836584.417834:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 25 pid: 6490 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.417873:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:0.0:1788836584.417882:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:2394:x1875730770219392:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836584.417897:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836584.417904:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 25 pid: 6490 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.417916:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 25 pid: 6490 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.417937:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554671 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa393 expref: 25 pid: 6490 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.417954:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.417959:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.417986:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.417994:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.418062:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836584.418108:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:2394:x1875730770219392:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 227us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836584.418116:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00010000:00010000:3.0:1788836584.418263:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.418272:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836584.418297:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788836584.418436:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554686 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 25 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.418452:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 24 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.418460:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:3.0:1788836584.418462:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836584.418465:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701200, rc 0) 00000100:00100000:3.0:1788836584.418491:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:10850:x1875730770219264:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6081us (6277us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788836584.418499:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:0.0:1788836584.421513:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836584.421631:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219520 00000100:00100000:1.0:1788836584.421641:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219520 00000100:00100000:1.0:1788836584.421698:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1788836584.421731:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:10850:x1875730770219520:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836584.421756:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836584.421785:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655469b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421832:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65546a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421846:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65546a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421856:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65546a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421966:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655469b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a1 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421983:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65546a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a1 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.421992:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:1.0:1788836584.421995:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836584.421999:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:2.0:1788836584.422923:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:10850:x1875730770219520:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1199us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836584.422933:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1788836584.426949:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836584.427059:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219776 00000100:00100000:2.0:1788836584.427069:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219776 00000100:00100000:2.0:1788836584.427119:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:2.0:1788836584.427130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:10850:x1875730770219776:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:2.0:1788836584.427351:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.427368:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.427379:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836584.427452:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788836584.427475:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000600f7371 reply state 00000000731cf368 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.427487:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.427495:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:2.0:1788836584.427498:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836584.427501:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788836584.427571:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788836584.427678:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:10850:x1875730770219776:12345-192.168.201.38@tcp:36:bash.0 Request processed in 549us (738us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788836584.427686:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000020:00080000:2.0:1788836584.427691:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788836584.435191:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.436139:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770219904 00000100:00100000:0.0:1788836584.436152:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770219904 00000100:00100000:0.0:1788836584.436219:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:0.0:1788836584.436228:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:10850:x1875730770219904:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836584.436250:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836584.436270:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65546b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3a8 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.436324:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65546b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a8 expref: 30 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.436338:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65546b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a8 expref: 30 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.436355:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.436358:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836584.436372:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00100000:0.0:1788836584.436430:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:10850:x1875730770219904:12345-192.168.201.38@tcp:101:bash.0 Request processed in 203us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836584.436437:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:3.0:1788836584.449813:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836584.449976:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220032 00000100:00100000:1.0:1788836584.449987:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220032 00000100:00100000:1.0:1788836584.450086:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1788836584.450097:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:10850:x1875730770220032:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836584.450131:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836584.450153:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3af expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836584.450179:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7ae5, atime: 0x6a9f7ae3, ctime: 0x6a9f7ae5, blocks: 0x8 00010000:00010000:1.0:1788836584.450201:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1788836584.450207:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836584.450217:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.450236:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.450250:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992400, rc 0) 00000100:00100000:1.0:1788836584.450319:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:10850:x1875730770220032:12345-192.168.201.38@tcp:101:bash.0 Request processed in 224us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836584.450327:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00080000:3.0:1788836584.450989:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836584.455373:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.455481:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220160 00000100:00100000:0.0:1788836584.455493:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220160 00002000:00010000:0.0:1788836584.455538:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788836584.455544:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8adf5071c700 with x1875730770220160 ext(0->18446744073709551615) 00002000:00010000:0.0:1788836584.455555:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8adf5071c700. 00000100:00100000:0.0:1788836584.455599:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1788836584.455611:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2396:x1875730770220160:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:0.0:1788836584.455898:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788836584.455902:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788836581 -> 1788836584 00002000:00010000:0.0:1788836584.455906:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788836579 -> 1788836579 00002000:00010000:0.0:1788836584.455908:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788836581 -> 1788836584 00002000:00010000:0.0:1788836584.455910:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788836584.455976:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2396:x1875730770220160:12345-192.168.201.38@tcp:10:bash.0 Request processed in 366us (614us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788836584.455984:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00010000:0.0:1788836584.455988:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788836584.455990:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8adf5071c700 with x1875730770220160 ext(0->18446744073709551615) 00002000:00010000:0.0:1788836584.455995:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8adf5071c700. 00000100:00100000:3.0:1788836584.536343:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.536453:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220288 00000100:00100000:0.0:1788836584.536463:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220288 00000100:00100000:0.0:1788836584.536520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1788836584.536529:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11344:x1875730770220288:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788836584.536625:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536642:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536654:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536669:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536676:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536682:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536752:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536760:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536766:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836584.536808:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536818:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536833:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536840:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536845:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.536850:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536857:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536869:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836584.536872:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836584.536876:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536883:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65546be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536895:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536901:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536906:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536911:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.536918:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536925:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536931:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ade43819500) 00010000:00010000:0.0:1788836584.536933:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836584.536936:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536941:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65546c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536953:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536959:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536964:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536969:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.536971:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536977:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536984:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.536986:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836584.536992:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.536998:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.537235:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11344:x1875730770220288:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 705us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836584.537243:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:1.0:1788836584.570242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836584.570558:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220544 00000100:00100000:2.0:1788836584.570574:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220544 00000100:00100000:2.0:1788836584.570663:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:2.0:1788836584.570674:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11347:x1875730770220544:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836584.570697:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836584.570729:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65546d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3b6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570801:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570817:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570850:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570867:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570875:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.570882:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571000:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65546e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571007:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65546e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571035:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65546e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836584.571045:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788836584.571119:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571124:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571128:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571132:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836584.571140:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571146:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571156:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836584.571159:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836584.571161:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571166:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65546da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571176:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571179:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571183:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571186:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836584.571188:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571191:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571194:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:2.0:1788836584.571195:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836584.571201:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571205:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65546e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571237:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65546d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3b6 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571245:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65546e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3b6 expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.571250:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:2.0:1788836584.571251:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788836584.571253:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030800, rc 0) 00000100:00100000:2.0:1788836584.571305:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11347:x1875730770220544:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 634us (1074us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788836584.571309:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:1.0:1788836584.581883:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.585067:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220672 00000100:00100000:0.0:1788836584.585083:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220672 00000100:00100000:0.0:1788836584.585152:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1788836584.585160:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11347:x1875730770220672:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788836584.585220:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.585234:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 32 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.585241:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.585268:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 32 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.585278:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 32 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.585290:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782887040:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836584.585379:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836584.589120:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.589158:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770220928 00000100:00100000:3.0:1788836584.589166:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770220928 00000100:00100000:3.0:1788836584.589210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1788836584.589216:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:6168:x1875730770220928:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788836584.589448:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:6168:x1875730770220928:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 232us (340us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788836584.589454:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1788836584.590069:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782887040:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836584.590097:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.591924:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.592040:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770221056 00000100:00100000:3.0:1788836584.592051:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770221056 00010000:00010000:3.0:1788836584.592102:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 34 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836584.592181:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1788836584.592191:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:2395:x1875730770221056:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836584.592208:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836584.592215:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 34 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592228:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 34 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592251:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a655468d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa39a expref: 34 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592267:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:3.0:1788836584.592272:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592282:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592290:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.592313:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836584.592363:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:2395:x1875730770221056:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836584.592371:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00010000:00010000:0.0:1788836584.592485:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592493:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592529:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592536:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592543:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592549:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.592554:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592561:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592570:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.592573:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836584.592577:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.592608:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.592645:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11347:x1875730770220672:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 7485us (10769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836584.592653:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:3.0:1788836584.595353:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.595429:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770221312 00000100:00100000:0.0:1788836584.595438:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770221312 00000100:00100000:0.0:1788836584.595492:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788836584.595502:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:11347:x1875730770221312:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836584.595736:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:11347:x1875730770221312:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 235us (392us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788836584.595744:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1788836584.681766:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.682006:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770221568 00000100:00100000:0.0:1788836584.682053:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770221568 00000100:00100000:0.0:1788836584.682108:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1788836584.682117:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:11358:x1875730770221568:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788836584.682139:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836584.682158:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3bd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682226:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682240:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682268:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682282:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682289:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682296:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682392:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682399:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682406:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836584.682414:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788836584.682504:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682512:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682518:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682524:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.682533:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682540:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682552:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836584.682555:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836584.682559:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682566:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554704 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682577:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682583:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682790:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682795:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836584.682799:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682805:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682813:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ade43819500) 00010000:00010000:0.0:1788836584.682815:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836584.682825:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682830:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655470b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682871:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65546fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3bd expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682885:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3bd expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.682892:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.682894:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836584.682897:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836584.682953:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11358:x1875730770221568:12345-192.168.201.38@tcp:101:cat.0 Request processed in 837us (1195us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788836584.682961:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:1.0:1788836584.693113:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.693211:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770221824 00000100:00100000:0.0:1788836584.693224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770221824 00000100:00100000:0.0:1788836584.693291:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788836584.693301:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11358:x1875730770221824:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:0.0:1788836584.693622:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+36:11358:x1875730770221824:12345-192.168.201.38@tcp:35:cat.0 Request processed in 320us (517us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788836584.693630:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1788836584.721684:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836584.721988:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222080 00000100:00100000:2.0:1788836584.722001:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222080 00000100:00100000:2.0:1788836584.722094:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:2.0:1788836584.722104:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+36:11359:x1875730770222080:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:2.0:1788836584.722164:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788836584.722190:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65546b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a8 expref: 36 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722211:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554712 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3bd expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722245:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65546e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3b6 expref: 34 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722257:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65546a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3a1 expref: 33 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722266:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:2.0:1788836584.722271:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836584.722294:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722306:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722315:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722328:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722334:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722340:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722419:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722699:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.722725:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836584.722937:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788836584.722947:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368628935043ns, next at 369628932071ns, rc = 0 00010000:00010000:2.0:1788836584.722994:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723004:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723059:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723067:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723073:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723079:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723149:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836584.723167:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723174:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723181:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723194:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836584.723198:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723206:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723218:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:2.0:1788836584.723221:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788836584.723225:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723231:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a655472e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723247:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723253:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723259:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723265:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836584.723268:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723274:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723292:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:2.0:1788836584.723294:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836584.723298:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723304:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554720 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836584.723315:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000729368ff reply state 00000000e4493d14 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723327:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836584.723333:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:2.0:1788836584.723335:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836584.723338:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836584.723784:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:11359:x1875730770222080:12345-192.168.201.38@tcp:36:rm.0 Request processed in 1321us (1750us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788836584.723793:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00010000:00010000:0.0:1788836584.725337:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836584.725351:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.725383:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836584.725387:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.725397:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.725413:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:0.0:1788836584.725416:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788836584.725432:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.725637:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554735 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.725659:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836584.725661:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836584.725662:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836584.807860:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836584.808204:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222336 00000100:00100000:1.0:1788836584.808216:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222336 00000100:00100000:1.0:1788836584.808279:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:1.0:1788836584.808289:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:11365:x1875730770222336:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836584.808332:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836584.808356:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655473c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3c4 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808485:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808502:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808514:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808528:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808536:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.808543:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836584.808888:0:10681:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788836584.809432:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809445:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809455:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809637:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809644:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809651:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809656:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836584.809661:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809668:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809681:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836584.809684:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836584.809689:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809695:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554743 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836584.809710:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db4e183 reply state 000000005c1ae198 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809723:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809729:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:1.0:1788836584.809737:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836584.809740:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788836584.809776:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a655473c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 37 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809792:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 36 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.809799:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:1.0:1788836584.809802:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836584.809804:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993400, rc 0) 00000100:00100000:1.0:1788836584.809879:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:11365:x1875730770222336:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1590us (2029us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788836584.809887:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:1.0:1788836584.815087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836584.815241:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222464 00000100:00100000:3.0:1788836584.815252:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222464 00000100:00100000:3.0:1788836584.815318:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788836584.815329:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770222464:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836584.815352:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836584.815378:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3cb expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836584.815407:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836584.815435:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1788836584.815441:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836584.815452:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.815475:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836584.815500:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701200, rc 0) 00000100:00100000:3.0:1788836584.815560:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770222464:12345-192.168.201.38@tcp:101:bash.0 Request processed in 233us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836584.815566:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00080000:0.0:1788836584.817041:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836584.830368:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836584.831629:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836584.831741:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222592 00000100:00100000:1.0:1788836584.831753:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222592 00000100:00100000:1.0:1788836584.831810:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1788836584.831820:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:11365:x1875730770222592:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836584.831838:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836584.831854:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3d2 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.831886:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.831897:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836584.831926:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836584.831933:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.831969:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.831983:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836584.831997:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782887168:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836584.832149:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836584.844702:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782887168:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836584.844744:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836584.844769:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992c00, rc 0) 00000100:00100000:1.0:1788836584.844840:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:11365:x1875730770222592:12345-192.168.201.38@tcp:101:bash.0 Request processed in 13020us (13218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836584.844849:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788836584.848689:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.848785:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222720 00000100:00100000:0.0:1788836584.848806:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222720 00010000:00010000:0.0:1788836584.848850:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.848896:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:0.0:1788836584.848916:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770222720:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836584.848935:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836584.848961:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.848991:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.849256:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a655475f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3cb expref: 9 pid: 8408 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.849275:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836584.849280:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836584.849288:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.849300:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836584.849343:0:13174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836584.849360:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13174:1875730782887296:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788836584.849462:0:13174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836584.852989:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13174:1875730782887296:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788836584.853056:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836584.853161:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770222720:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4253us (4479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836584.853172:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1788836584.857340:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836584.857768:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770222976 00000100:00100000:0.0:1788836584.857779:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770222976 00000100:00100000:0.0:1788836584.857855:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1788836584.857881:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:11365:x1875730770222976:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788836584.858317:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11365:x1875730770222976:12345-192.168.201.38@tcp:35:bash.0 Request processed in 436us (985us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788836584.858326:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788836585.051408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.051512:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770223104 00000100:00100000:0.0:1788836585.051523:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770223104 00000100:00100000:0.0:1788836585.051604:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:0.0:1788836585.051617:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:11381:x1875730770223104:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.051647:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.051670:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a655476d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051748:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051760:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051768:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.051815:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788836585.051818:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836585.051833:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051852:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a655476d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d9 expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051867:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d9 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.051890:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.051892:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836585.051895:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7400, rc 0) 00000100:00100000:0.0:1788836585.051956:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:11381:x1875730770223104:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 342us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.051963:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:3.0:1788836585.055285:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.055376:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770223360 00000100:00100000:0.0:1788836585.055386:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770223360 00000100:00100000:0.0:1788836585.055463:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:0.0:1788836585.055474:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:11381:x1875730770223360:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.055497:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.055520:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655477b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3e0 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.055650:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.055667:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.055679:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.055691:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788836585.055813:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a655477b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e0 expref: 42 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.055852:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e0 expref: 41 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.055862:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:0.0:1788836585.055865:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836585.055870:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836585.055943:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:11381:x1875730770223360:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 470us (668us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788836585.055950:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:2.0:1788836585.060054:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.060207:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770223616 00000100:00100000:0.0:1788836585.060217:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770223616 00000100:00100000:0.0:1788836585.060278:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:0.0:1788836585.060289:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:11381:x1875730770223616:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.060312:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.060332:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554790 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3e7 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.060467:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.060491:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.060504:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.060517:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788836585.060645:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554790 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e7 expref: 44 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.060662:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e7 expref: 43 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.060671:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:0.0:1788836585.060673:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788836585.060677:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836585.060742:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:11381:x1875730770223616:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 455us (736us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788836585.060750:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:2.0:1788836585.065858:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.066188:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770223744 00000100:00100000:1.0:1788836585.066199:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770223744 00000100:00100000:1.0:1788836585.066266:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788836585.066284:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:2395:x1875730770223744:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836585.066303:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836585.066331:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e0 expref: 43 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.066351:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:1.0:1788836585.066356:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836585.066414:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:2395:x1875730770223744:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 131us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.066431:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836585.071540:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.071655:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770223872 00000100:00100000:2.0:1788836585.071669:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770223872 00000100:00100000:2.0:1788836585.071734:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:2.0:1788836585.071746:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2396:x1875730770223872:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:2.0:1788836585.071803:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.071825:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.071834:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836585.071838:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836585.071842:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.071879:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.071892:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 8 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.071907:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8408:1875730782887424:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836585.072041:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836585.075606:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.075757:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224000 00000100:00100000:1.0:1788836585.075769:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224000 00002000:00100000:1.0:1788836585.075823:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ade439f3b80 x1875730770224000/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:751/0 lens 504/0 e 0 to 0 dl 1788836596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836585.075834:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439f3b80 with x1875730770224000 ext(0->8) 00010000:00010000:1.0:1788836585.075844:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 9 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.075860:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 9 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836585.075870:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade439f3b80 00000100:00100000:1.0:1788836585.075906:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1788836585.075916:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770224000:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:1.0:1788836585.077973:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2395:x1875730770224000:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 2048us (2368us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788836585.077994:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00100000:1.0:1788836585.078166:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ade439f3b80 x1875730770224000/t4294967303(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:751/0 lens 504/448 e 0 to 0 dl 1788836596 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836585.078177:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439f3b80 with x1875730770224000 ext(0->8) 00010000:00010000:1.0:1788836585.078189:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 11 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.078207:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 11 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836585.078216:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade439f3b80 00000001:00080000:2.0:1788836585.079672:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788836585.079689:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788836585.080389:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8408:1875730782887424:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836585.080446:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.082119:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.082320:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224128 00000100:00100000:1.0:1788836585.082329:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224128 00010000:00010000:1.0:1788836585.082368:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 7 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.082414:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:1.0:1788836585.082433:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770224128:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836585.082452:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788836585.082485:0:6474:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788836585.082488:0:6474:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788836584 00002000:00010000:1.0:1788836585.082491:0:6474:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788836584 00002000:00010000:1.0:1788836585.082493:0:6474:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788836584 00002000:00010000:1.0:1788836585.082496:0:6474:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788836585.082503:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 7 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.082531:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 7 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.082555:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2b888a/0xf7b38383a6554766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d2 expref: 7 pid: 8407 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.082574:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836585.082587:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836585.082594:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.082605:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.082637:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836585.082699:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770224128:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 276us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.082708:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00010000:00010000:3.0:1788836585.083807:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083821:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083844:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083853:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083862:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083870:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836585.083874:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083882:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083916:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.083924:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9152b13/0xf7b38383a65547a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.084043:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770223872:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 12297us (12515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836585.084051:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788836585.087681:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.087850:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224384 00000100:00100000:0.0:1788836585.087860:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224384 00000100:00100000:0.0:1788836585.087924:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:0.0:1788836585.087935:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:11381:x1875730770224384:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:0.0:1788836585.088047:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e7 expref: 42 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836585.088268:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788836585.088302:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788836585.088667:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788836585.088704:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.088718:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.088726:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.088764:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.088778:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 46 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.088792:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782887552:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836585.088884:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836585.092433:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.092548:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782887552:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836585.092574:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.093781:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224512 00000100:00100000:1.0:1788836585.093793:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224512 00010000:00010000:1.0:1788836585.093836:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 47 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.093928:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788836585.093948:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:2397:x1875730770224512:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836585.093982:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836585.093990:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 47 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094025:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 47 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094048:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554751 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3c4 expref: 47 pid: 10681 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094066:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:1.0:1788836585.094072:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094081:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094089:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.094117:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836585.094230:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.094239:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836585.094346:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788836585.094494:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788836585.094597:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782887680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788836585.094648:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836585.094677:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836585.094709:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782887680 00000100:00100000:0.0:1788836585.094714:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782887680 00000100:00100000:0.0:1788836585.094754:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788836585.094761:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875730782887680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788836585.094840:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875730782887680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.094847:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788836585.094875:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836585.094897:0:6493:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788836585.094902:0:6493:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1788836585.094916:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade4455aa00, transno 4294967302 00000100:00100000:0.0:1788836585.094928:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782887680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788836585.095059:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788836585.095112:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782887808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788836585.095137:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836585.095152:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836585.095224:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782887808 00000100:00100000:0.0:1788836585.095228:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782887808 00000100:00100000:0.0:1788836585.095251:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788836585.095257:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1875730782887808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788836585.095345:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6493:x1875730782887808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (207us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788836585.095352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788836585.095382:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782887808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788836585.095410:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788836585.095435:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095444:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095450:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095455:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.095466:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095474:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095485:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:0.0:1788836585.095488:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788836585.095492:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.095498:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836585.095575:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788836585.095637:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788836585.095648:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369001635936ns, next at 370001633942ns, rc = 0 00000001:00080000:0.0:1788836585.095654:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788836585.095675:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade438f2c00) 00010000:00010000:0.0:1788836585.095679:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788836585.095684:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554797 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3e7 expref: 51 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.096150:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:2397:x1875730770224512:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 2210us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.096158:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1788836585.096215:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:11381:x1875730770224384:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 8282us (8544us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788836585.096222:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000020:00080000:0.0:1788836585.096226:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788836585.099631:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.099713:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224640 00000100:00100000:0.0:1788836585.099724:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224640 00000100:00100000:0.0:1788836585.099820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:0.0:1788836585.099832:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:11381:x1875730770224640:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.099886:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.099910:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65547b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3ee expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.099979:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65547b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3ee expref: 50 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.099996:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65547b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3ee expref: 50 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.100404:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.100408:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836585.100411:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6400, rc 0) 00000100:00100000:0.0:1788836585.100722:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:11381:x1875730770224640:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 890us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.100729:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:2.0:1788836585.103734:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.103877:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770224896 00000100:00100000:3.0:1788836585.103887:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770224896 00000100:00100000:3.0:1788836585.103953:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836585.103963:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:11381:x1875730770224896:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836585.104414:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:11381:x1875730770224896:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 450us (687us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788836585.104553:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788836585.202511:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.203175:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770225024 00000100:00100000:1.0:1788836585.203186:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770225024 00000100:00100000:1.0:1788836585.203297:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:1.0:1788836585.203308:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:11391:x1875730770225024:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:1.0:1788836585.203400:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203418:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203727:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203745:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203753:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203760:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203833:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203841:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203846:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836585.203896:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203908:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203925:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.203931:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204082:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.204089:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204097:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204110:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836585.204113:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.204119:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204265:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65547ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204280:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204286:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204292:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204296:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.204305:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204311:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204320:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:1.0:1788836585.204323:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.204326:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204332:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a65547c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204342:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204348:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204353:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204358:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.204361:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204367:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204374:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836585.204376:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.204385:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.204391:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65547c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.205489:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:11391:x1875730770225024:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 2175us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.205502:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:0.0:1788836585.214491:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836585.214516:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782887936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836585.214595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836585.214731:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782887936 00000100:00100000:1.0:1788836585.214739:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782887936 00000100:00100000:1.0:1788836585.214791:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788836585.214802:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782887936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836585.214835:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788836585.214886:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782887936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.214894:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836585.215209:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782887936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836585.263179:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.263294:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770225280 00000100:00100000:0.0:1788836585.263305:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770225280 00000100:00100000:0.0:1788836585.263369:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:0.0:1788836585.263380:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:11394:x1875730770225280:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.263399:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.263433:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65547cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3f5 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263845:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263861:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263873:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263885:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263893:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.263899:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264061:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264071:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264077:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.264087:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788836585.264166:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264184:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264190:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264196:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.264200:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264207:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264218:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.264221:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.264225:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264231:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a65547d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264244:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264250:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264256:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264261:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.264270:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264277:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264286:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:0.0:1788836585.264288:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.264291:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264298:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a65547dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264333:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65547cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 54 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264345:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 53 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.264352:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.264354:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836585.264356:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7800, rc 0) 00000100:00100000:0.0:1788836585.264408:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11394:x1875730770225280:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1031us (1240us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788836585.264415:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:2.0:1788836585.267715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.267868:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770225408 00000100:00100000:0.0:1788836585.267880:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770225408 00000100:00100000:3.0:1788836585.268216:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:3.0:1788836585.268229:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11394:x1875730770225408:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788836585.268302:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268329:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268340:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268376:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268383:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268389:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268395:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836585.268399:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268406:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268417:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836585.268434:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836585.268441:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.268447:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a65547f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.268700:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11394:x1875730770225408:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 473us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836585.268714:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:2.0:1788836585.271799:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.271894:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770225664 00000100:00100000:1.0:1788836585.271906:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770225664 00000100:00100000:1.0:1788836585.271978:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836585.271989:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+53:11394:x1875730770225664:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836585.272345:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11394:x1875730770225664:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 357us (557us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788836585.272353:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836585.374748:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.375144:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770225920 00000100:00100000:0.0:1788836585.375156:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770225920 00000100:00100000:0.0:1788836585.375239:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:0.0:1788836585.375250:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11404:x1875730770225920:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836585.375274:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.375277:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788836585.375306:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a6554774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3d9 expref: 54 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375326:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.375331:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836585.375344:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65547f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa3fc expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375457:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375479:0:12185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 54 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375487:0:12185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375521:0:12185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 54 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.375535:0:12185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 54 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.375548:0:12185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888064:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836585.375658:0:12185:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836585.377893:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.378202:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226048 00000100:00100000:2.0:1788836585.378212:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226048 00010000:00010000:2.0:1788836585.378258:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 55 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.378300:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1788836585.378310:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:2394:x1875730770226048:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.378324:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.378331:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 55 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.378344:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 55 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.378364:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.378369:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.378378:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.378386:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.378403:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.378481:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:2394:x1875730770226048:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 172us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.378489:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00010000:00010000:0.0:1788836585.379441:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a65547e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3f5 expref: 54 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.379462:0:12185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888064:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836585.379491:0:12185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.379499:0:12185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.379504:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.379528:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788836585.379672:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65547f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 55 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.379686:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 54 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.379694:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.379696:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836585.379699:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6800, rc 0) 00000100:00100000:0.0:1788836585.379925:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11404:x1875730770225920:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4675us (5185us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788836585.379933:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:1.0:1788836585.386571:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.386667:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226176 00000100:00100000:0.0:1788836585.386680:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226176 00000100:00100000:0.0:1788836585.386734:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:0.0:1788836585.386744:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:11404:x1875730770226176:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788836585.386768:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.386787:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655480e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa403 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386819:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386832:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386844:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386948:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a655480e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 56 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386965:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 55 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.386973:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.386976:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836585.386980:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6a00, rc 0) 00000100:00100000:0.0:1788836585.387081:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:11404:x1875730770226176:12345-192.168.201.38@tcp:101:bash.0 Request processed in 338us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.387088:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:3.0:1788836585.389387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.389481:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226432 00000100:00100000:0.0:1788836585.389500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226432 00000100:00100000:0.0:1788836585.389556:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:0.0:1788836585.389565:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:11404:x1875730770226432:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:0.0:1788836585.389794:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.389812:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.389823:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836585.389865:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1788836585.389888:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000556bbe35 reply state 00000000b6aa6b4f transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.389901:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.389908:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.389911:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836585.389914:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836585.390004:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11404:x1875730770226432:12345-192.168.201.38@tcp:36:bash.0 Request processed in 438us (626us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788836585.391340:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000020:00080000:0.0:1788836585.391347:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788836585.396737:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.396997:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226560 00000100:00100000:1.0:1788836585.397053:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226560 00000100:00100000:1.0:1788836585.397108:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788836585.397119:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11404:x1875730770226560:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836585.397147:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836585.397169:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554823 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa40a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.397654:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.397670:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 59 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.397680:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.397715:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 59 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.397729:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 59 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.397742:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782888192:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836585.397835:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836585.401008:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.401323:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226688 00000100:00100000:3.0:1788836585.401332:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226688 00010000:00010000:3.0:1788836585.401369:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 60 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.401409:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:3.0:1788836585.401419:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:2394:x1875730770226688:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836585.401444:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836585.401450:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 60 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.401464:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 60 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.401493:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836585.401500:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.401510:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.401517:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.401535:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836585.401609:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:2394:x1875730770226688:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 191us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836585.401617:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00010000:00010000:2.0:1788836585.403132:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554800 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3fc expref: 59 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.403156:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782888192:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836585.403180:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.403191:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.403196:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836585.403307:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788836585.403312:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836585.403332:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.403365:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554823 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.403379:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.403387:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.403390:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836585.403408:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993400, rc 0) 00000100:00100000:2.0:1788836585.403680:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11404:x1875730770226560:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6562us (6952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.403688:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788836585.407212:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.407337:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770226944 00000100:00100000:3.0:1788836585.407347:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770226944 00000100:00100000:3.0:1788836585.407409:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1788836585.407418:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:11404:x1875730770226944:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1788836585.407684:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:11404:x1875730770226944:12345-192.168.201.38@tcp:35:bash.0 Request processed in 266us (480us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788836585.407692:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1788836585.500509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.500620:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227072 00000100:00100000:0.0:1788836585.500631:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227072 00000100:00100000:0.0:1788836585.500697:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1788836585.500707:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:11410:x1875730770227072:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.500749:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.500773:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa411 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500843:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500856:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500866:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.500916:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788836585.500920:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836585.500938:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500962:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa411 expref: 61 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500979:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa411 expref: 60 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.500988:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.500990:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836585.500994:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836585.501110:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770227072:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 405us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.501117:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1788836585.504413:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.504559:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227200 00000100:00100000:3.0:1788836585.504570:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227200 00000100:00100000:3.0:1788836585.504644:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1788836585.504655:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770227200:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836585.504674:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836585.504695:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a655483f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa418 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504757:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504771:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504783:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504793:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504815:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504822:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504895:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504904:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504910:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836585.504954:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788836585.504959:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836585.504978:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.504991:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505051:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505059:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505065:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505082:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836585.505086:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505094:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505107:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:3.0:1788836585.505110:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836585.505115:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505120:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554846 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505133:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505139:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505145:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505150:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836585.505153:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505159:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505179:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:3.0:1788836585.505182:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836585.505185:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505192:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a655484d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505437:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a655483f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505663:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.505671:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836585.505674:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836585.505677:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701e00, rc 0) 00000100:00100000:2.0:1788836585.506551:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11410:x1875730770227200:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1891us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.506562:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1788836585.511864:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.511964:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227456 00000100:00100000:0.0:1788836585.511976:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227456 00000100:00100000:0.0:1788836585.512177:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:0.0:1788836585.512189:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11410:x1875730770227456:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.512211:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.512232:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a655485b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa41f expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512341:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512357:0:12185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 62 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512365:0:12185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512372:0:12185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512405:0:12185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.512418:0:12185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.512432:0:12185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888320:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836585.513362:0:12185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 62 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.513388:0:12185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 62 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.513399:0:12185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888448:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836585.517980:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.518359:0:12185:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.522288:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:0.0:1788836585.522617:0:12185:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.38@tcp) returned -22 from blocking AST (req@0000000028f1c717 x1875730782888320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.522642:0:12185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.522669:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa418 expref: 62 pid: 6490 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.522688:0:12185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888320:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836585.522704:0:12185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12185:1875730782888448:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836585.522724:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.522730:0:12185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.522738:0:12185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.522747:0:12185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.523748:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227584 00000100:00100000:1.0:1788836585.523771:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227584 00000100:00100000:1.0:1788836585.523871:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227712 00000100:00100000:1.0:1788836585.523875:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227712 00010000:00010000:1.0:1788836585.523894:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 63 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.523939:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788836585.523950:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:2394:x1875730770227712:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.523966:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.523973:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 63 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.523984:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 63 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.524040:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a655482a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa40a expref: 63 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.524193:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.524198:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.524207:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.524215:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.524250:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.524305:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:2394:x1875730770227712:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 357us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.524313:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788836585.524332:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1788836585.524338:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:2395:x1875730770227584:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.524346:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.524349:0:13174:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie f7b38383a6554854) 00010000:00010000:2.0:1788836585.524350:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.524367:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:2395:x1875730770227584:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 29us (6400us total) trans 0 rc 116/116 00000100:00100000:2.0:1788836585.524373:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:0.0:1788836585.524547:0:12185:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.524556:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.524584:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788836585.524712:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a655485b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 62 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.524729:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 61 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.524736:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.524738:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836585.524741:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f6000, rc 0) 00000100:00100000:0.0:1788836585.526150:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11410:x1875730770227456:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 13857us (14191us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788836585.526164:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1788836585.529908:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.529972:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770227968 00000100:00100000:0.0:1788836585.529982:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770227968 00000100:00100000:0.0:1788836585.530078:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1788836585.530089:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11410:x1875730770227968:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:0.0:1788836585.530105:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836585.530129:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65547b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3ee expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.530165:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.530170:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836585.531062:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770227968:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 969us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.531072:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788836585.533640:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.533765:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228096 00000100:00100000:0.0:1788836585.533774:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228096 00000100:00100000:0.0:1788836585.533831:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:0.0:1788836585.533840:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770228096:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:0.0:1788836585.533975:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.533993:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.534044:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836585.534149:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788836585.534234:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770228096:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 393us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.534241:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:2.0:1788836585.537884:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.537972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228224 00000100:00100000:0.0:1788836585.537984:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228224 00000100:00100000:0.0:1788836585.538186:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:0.0:1788836585.538196:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:11410:x1875730770228224:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836585.538218:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.538255:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa426 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538320:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538332:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538355:0:6492:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538370:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538384:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.538387:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836585.538391:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.538399:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7800, rc 0) 00000100:00100000:0.0:1788836585.538512:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11410:x1875730770228224:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 317us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.538520:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000040:00080000:3.0:1788836585.598332:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836585.598343:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836585.598388:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788836585.598398:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836585.598546:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782888576:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836585.598723:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836585.603684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.603781:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782888576:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836585.604048:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228352 00000100:00100000:1.0:1788836585.604056:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228352 00000100:00100000:1.0:1788836585.604112:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:1.0:1788836585.604120:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11411:x1875730770228352:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836585.604148:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836585.604256:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11411:x1875730770228352:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 136us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.604264:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:1.0:1788836585.607722:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.607818:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228480 00000100:00100000:0.0:1788836585.607828:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228480 00000100:00100000:0.0:1788836585.607884:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1788836585.607894:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11411:x1875730770228480:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.607977:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608048:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608061:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608079:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608086:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608093:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608114:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608122:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608128:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.608175:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788836585.608179:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836585.608190:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608200:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608216:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608223:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608229:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.608234:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608243:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608257:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:0.0:1788836585.608260:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.608265:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608271:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a655487e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608285:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608291:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608297:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608301:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.608309:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608315:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608322:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8ade43819c00) 00010000:00010000:0.0:1788836585.608324:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.608327:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608332:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a6554885 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608344:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608350:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608356:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608360:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.608363:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608368:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608374:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836585.608377:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.608385:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.608391:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655488c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.608476:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11411:x1875730770228480:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 583us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.608483:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:3.0:1788836585.611948:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.612133:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228736 00000100:00100000:2.0:1788836585.612144:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228736 00000100:00100000:2.0:1788836585.612208:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:2.0:1788836585.612219:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:11411:x1875730770228736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836585.612241:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836585.612262:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554893 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa42d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612370:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612386:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612407:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836585.612420:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788836585.612508:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612516:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612522:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612529:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836585.612533:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612540:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612551:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.612554:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788836585.612558:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612564:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a655489a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612624:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554893 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa42d expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612648:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:2.0:1788836585.612651:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836585.612655:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554893 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa42d expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.612667:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:2.0:1788836585.612868:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770228736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 650us (939us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788836585.612876:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:2.0:1788836585.616518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.616607:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770228864 00000100:00100000:1.0:1788836585.616617:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770228864 00000100:00100000:1.0:1788836585.616672:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1788836585.616682:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770228864:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836585.616714:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836585.616821:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770228864:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.616828:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1788836585.621052:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.621142:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770229120 00000100:00100000:0.0:1788836585.621154:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770229120 00000100:00100000:0.0:1788836585.621225:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:0.0:1788836585.621236:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770229120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.621257:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.621261:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788836585.621290:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a6554838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa411 expref: 62 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621309:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.621314:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836585.621326:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa434 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836585.621735:0:10333:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788836585.621881:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65548af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621894:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65548af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621923:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65548af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621977:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa434 expref: 64 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621992:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65548af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa434 expref: 63 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.621999:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade43819c00) 00010000:00010000:0.0:1788836585.622002:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836585.622004:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:0.0:1788836585.622104:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:11411:x1875730770229120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 870us (1104us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788836585.622112:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:3.0:1788836585.626260:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.626356:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770229376 00000100:00100000:0.0:1788836585.626366:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770229376 00000100:00100000:0.0:1788836585.626441:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:0.0:1788836585.626451:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:11411:x1875730770229376:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.626544:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836585.626581:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a65548af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa434 expref: 63 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626601:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade43819c00) 00010000:00010000:0.0:1788836585.626614:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836585.626635:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626654:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626664:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626726:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626734:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626741:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626784:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626792:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626799:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626805:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.626809:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626817:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626826:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:0.0:1788836585.626835:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.626839:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626846:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a65548bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626856:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626862:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626868:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626873:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836585.626876:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626883:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626891:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3fadb835 (ffff8ade43819600) 00010000:00010000:0.0:1788836585.626893:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836585.626897:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.626902:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3fadb835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.627197:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770229376:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 746us (947us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836585.627211:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1788836585.630723:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.630872:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770229504 00000100:00100000:1.0:1788836585.630883:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770229504 00000100:00100000:1.0:1788836585.630950:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:1.0:1788836585.630961:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:11411:x1875730770229504:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836585.631006:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836585.631063:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65548cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa43b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631101:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631114:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631125:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631232:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a65548cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631251:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.631260:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:1.0:1788836585.631264:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836585.631267:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992c00, rc 0) 00000100:00100000:1.0:1788836585.631323:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:11411:x1875730770229504:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 364us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.631330:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:1.0:1788836585.634314:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.634381:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770229760 00000100:00100000:0.0:1788836585.634393:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770229760 00000100:00100000:0.0:1788836585.634604:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:0.0:1788836585.634614:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:11411:x1875730770229760:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.634695:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.634714:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.634725:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836585.634883:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1788836585.634947:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f59446a reply state 0000000003e48e4d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.634961:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.634969:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:0.0:1788836585.634972:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788836585.634976:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836585.635096:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:11411:x1875730770229760:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 483us (791us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788836585.635105:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:3.0:1788836585.637730:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.637808:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770229888 00000100:00100000:0.0:1788836585.637819:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770229888 00000100:00100000:0.0:1788836585.637894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:0.0:1788836585.637904:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:11411:x1875730770229888:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.637941:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.637963:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa442 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.638141:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.638157:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.638178:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:0.0:1788836585.638181:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836585.638185:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade438f7a00, rc 0) 00000100:00100000:0.0:1788836585.638325:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:11411:x1875730770229888:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 422us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.638332:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:2.0:1788836585.640503:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.640607:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770230016 00000100:00100000:0.0:1788836585.640617:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770230016 00000100:00100000:0.0:1788836585.640706:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:0.0:1788836585.640716:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770230016:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788836585.640939:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770230016:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 215us (437us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788836585.640947:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1788836585.643819:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.643890:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770230272 00000100:00100000:3.0:1788836585.643899:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770230272 00000100:00100000:3.0:1788836585.643946:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836585.643953:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:11411:x1875730770230272:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836585.644558:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:11411:x1875730770230272:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 602us (743us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788836585.644567:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836585.647414:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.647700:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770230528 00000100:00100000:1.0:1788836585.647724:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770230528 00000100:00100000:1.0:1788836585.647787:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:1.0:1788836585.647797:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:11411:x1875730770230528:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836585.648318:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:11411:x1875730770230528:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 521us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.648326:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:2.0:1788836585.653415:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.654289:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770230656 00000100:00100000:0.0:1788836585.654315:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770230656 00000100:00100000:0.0:1788836585.654379:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:0.0:1788836585.654389:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:11411:x1875730770230656:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836585.654410:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836585.657147:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65548e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa449 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657227:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657241:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657253:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836585.657298:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836585.657316:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657340:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6400/0xf7b38383a65548e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa449 expref: 69 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657355:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa449 expref: 68 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.657360:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:0.0:1788836585.657363:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788836585.657365:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82172c00, rc 0) 00000100:00100000:0.0:1788836585.657432:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:11411:x1875730770230656:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 3045us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.657453:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:2.0:1788836585.663350:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.663536:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770230784 00000100:00100000:1.0:1788836585.663548:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770230784 00000100:00100000:1.0:1788836585.663659:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:1.0:1788836585.663670:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770230784:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836585.663687:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836585.663708:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa450 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836585.663732:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7ae9, blocks: 0x0 00010000:00010000:1.0:1788836585.663750:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1788836585.663754:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836585.663763:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 10 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.663781:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 10 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.663792:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993400, rc 0) 00000100:00100000:1.0:1788836585.663848:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770230784:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 180us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.663871:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788836585.665829:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.665896:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231040 00000100:00100000:2.0:1788836585.665903:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231040 00000100:00100000:2.0:1788836585.665951:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:2.0:1788836585.665958:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:11411:x1875730770231040:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836585.666300:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:11411:x1875730770231040:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 342us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.666306:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:2.0:1788836585.668412:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.668494:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231168 00000100:00100000:1.0:1788836585.668504:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231168 00000100:00100000:1.0:1788836585.668560:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788836585.668581:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:11411:x1875730770231168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836585.668598:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836585.668618:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa457 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.668649:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.668656:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836585.668659:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836585.668663:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.668688:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.668698:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.668708:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8407:1875730782888704:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836585.668778:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.674645:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8407:1875730782888704:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836585.674684:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.674705:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:3.0:1788836585.674771:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:11411:x1875730770231168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 6202us (6365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836585.674782:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788836585.674862:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.675288:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231296 00000100:00100000:0.0:1788836585.675297:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231296 00010000:00010000:0.0:1788836585.675327:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.675366:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:0.0:1788836585.675375:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2394:x1875730770231296:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836585.675388:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836585.675409:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.675422:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.675443:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42dca14/0xf7b38383a65548f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa450 expref: 11 pid: 8498 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.675469:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836585.675474:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836585.675482:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.675490:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.675633:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.675647:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6476:1875730782888832:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788836585.675806:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.680309:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.680552:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44554700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6476:1875730782888832:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788836585.680588:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836585.680640:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2394:x1875730770231296:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 5265us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.680651:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1788836585.681966:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231424 00000100:00100000:2.0:1788836585.681978:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231424 00002000:00100000:2.0:1788836585.682043:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ade436c7480 x1875730770231424/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:751/0 lens 504/0 e 0 to 0 dl 1788836596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836585.682067:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade436c7480 with x1875730770231424 ext(0->12) 00002000:00010000:2.0:1788836585.682072:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade436c7480 00000100:00100000:2.0:1788836585.682099:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788836585.682109:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2394:x1875730770231424:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788836585.683393:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:2394:x1875730770231424:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 1277us (3086us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788836585.683405:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:2.0:1788836585.683417:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ade436c7480 x1875730770231424/t4294967309(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:751/0 lens 504/448 e 0 to 0 dl 1788836596 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836585.683428:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade436c7480 with x1875730770231424 ext(0->12) 00002000:00010000:2.0:1788836585.683433:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade436c7480 00000100:00100000:3.0:1788836585.686373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.686478:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231552 00000100:00100000:0.0:1788836585.686488:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231552 00000100:00100000:0.0:1788836585.686557:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:0.0:1788836585.686565:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:11411:x1875730770231552:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788836585.688496:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:1.0:1788836585.688608:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688622:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688629:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688635:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688640:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688647:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688662:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ade43819100) 00010000:00010000:1.0:1788836585.688665:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.688669:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688675:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554601 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688701:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688707:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688712:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688727:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688730:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688736:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688743:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adf77296e00) 00010000:00010000:1.0:1788836585.688746:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.688749:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688755:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65546a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688771:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688776:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688782:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688787:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688790:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688795:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688814:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:1.0:1788836585.688816:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.688819:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688825:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554727 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688836:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688842:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688848:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688854:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688856:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688863:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688870:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7800) 00010000:00010000:1.0:1788836585.688872:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.688875:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688881:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a655474a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688901:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688907:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688913:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688918:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688921:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688926:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688933:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836585.688936:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.688938:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688944:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7400/0xf7b38383a655481c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688954:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688959:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688964:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688975:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.688978:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.688984:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.689004:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:1.0:1788836585.689006:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788836585.689056:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.689064:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a65548d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836585.689262:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788836585.689284:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adf5109af00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788836585.689288:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf77274e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adf5109a600 00000020:00080000:3.0:1788836585.689291:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf77274700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade43a3a400 00000004:00080000:3.0:1788836585.689323:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788836585.689367:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adf48b37900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788836585.689371:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ade429d7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adf48b37d80 00000020:00080000:3.0:1788836585.689373:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ade429d7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adf773ea800 00000020:00080000:1.0:1788836585.689428:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788836585.689501:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788836585.689851:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11411:x1875730770231552:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 3282us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.689861:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:1.0:1788836585.690384:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782888960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788836585.690436:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836585.690492:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836585.690499:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782889088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836585.690694:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836585.690856:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782888960 00000100:00100000:2.0:1788836585.690864:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782888960 00000100:00100000:2.0:1788836585.690906:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782889088 00000100:00100000:2.0:1788836585.690909:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782889088 00000100:00100000:2.0:1788836585.690946:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836585.690954:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782888960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788836585.690980:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1788836585.691049:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7ae8, atime: 0x6a9f7ae8, ctime: 0x6a9f7ae8, blocks: 0x8 00010000:00010000:2.0:1788836585.691058:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691074:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1788836585.691078:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836585.691097:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691113:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691123:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691130:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691146:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836585.691275:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782888960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 321us (838us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788836585.691282:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836585.691296:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836585.691302:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782889088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788836585.691313:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788836585.691325:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691338:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691345:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788836585.691347:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836585.691357:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691382:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 11 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.691396:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 11 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.691409:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1875730782889216:192.168.201.38@tcp:104: 00000100:00080000:3.0:1788836585.691664:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836585.691781:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836585.691789:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.691797:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836585.691801:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.691816:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.691831:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.691838:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554903 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.691856:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836585.691858:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836585.691860:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788836585.691889:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade44555880/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788836585.691895:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782888960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788836585.692404:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.696837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.696894:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231680 00000100:00100000:1.0:1788836585.696905:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231680 00010000:00010000:1.0:1788836585.696947:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 12 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.697005:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788836585.697049:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:2395:x1875730770231680:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836585.697065:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836585.697071:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 12 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.697105:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 12 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.697134:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836585.697138:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836585.697145:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.697156:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.697175:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836585.697223:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:2395:x1875730770231680:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 177us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.697230:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00010000:00010000:2.0:1788836585.697913:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074f23361/0xf7b38383a65546b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa3af expref: 11 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.697931:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1875730782889216:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836585.697953:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.697963:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.697970:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.697980:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.698007:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.698058:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836585.698245:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782889088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6942us (7549us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788836585.698252:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1788836585.698316:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836585.698324:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.698331:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836585.698335:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.698354:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.698367:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.698373:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6506923/0xf7b38383a655490a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.698389:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836585.698391:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836585.698392:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788836585.698471:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade4390bb80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788836585.698487:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782889088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836585.699831:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.700468:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770231808 00000100:00100000:0.0:1788836585.700479:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770231808 00000100:00100000:0.0:1788836585.700538:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788836585.700548:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2394:x1875730770231808:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788836585.703252:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788836585.703267:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788836585.703437:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770231808:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 2885us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.703448:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788836585.707162:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.707254:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232064 00000100:00100000:3.0:1788836585.707265:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232064 00000100:00100000:3.0:1788836585.707324:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1788836585.707335:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11411:x1875730770232064:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836585.707390:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836585.707418:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a65548ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa449 expref: 16 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.707645:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:3.0:1788836585.707651:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836585.707682:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.707696:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.707705:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836585.707840:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006118399f reply state 000000001751bb3e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.707852:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.707858:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:3.0:1788836585.707861:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836585.707864:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836585.707959:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11411:x1875730770232064:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 626us (810us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788836585.707968:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1788836585.710953:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.711038:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232192 00000100:00100000:1.0:1788836585.711047:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232192 00000100:00100000:1.0:1788836585.711100:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1788836585.711109:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770232192:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788836585.711257:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788836585.711273:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788836585 00002000:00010000:1.0:1788836585.711275:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788836584 00002000:00010000:1.0:1788836585.711278:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788836585 -> 1788836585 00002000:00010000:1.0:1788836585.711280:0:8498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788836585.711334:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770232192:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 226us (389us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788836585.711341:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1788836585.713267:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.713334:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232448 00000100:00100000:3.0:1788836585.713342:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232448 00000100:00100000:3.0:1788836585.713390:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:3.0:1788836585.713398:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:11411:x1875730770232448:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788836585.713464:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.713480:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.713490:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.713646:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.713681:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 17 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.713699:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782889344:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836585.713783:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.716313:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.716520:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232576 00000100:00100000:2.0:1788836585.716530:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232576 00010000:00010000:2.0:1788836585.716578:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 18 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.716617:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:2.0:1788836585.716627:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770232576:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.716644:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.716650:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 18 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.716662:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 18 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.716683:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:2.0:1788836585.716689:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.716698:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.716717:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.716733:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.716781:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770232576:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 155us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.716788:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00010000:00010000:1.0:1788836585.718287:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a65548d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa43b expref: 17 pid: 6491 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.718309:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782889344:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836585.718331:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718340:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718346:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718389:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718396:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718404:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718614:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.718619:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718628:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718643:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:1.0:1788836585.718647:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788836585.718651:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.718658:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554918 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.718773:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11411:x1875730770232448:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 5374us (5510us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788836585.718783:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:3.0:1788836585.720853:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.721325:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232704 00000100:00100000:1.0:1788836585.721335:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232704 00000100:00100000:1.0:1788836585.721436:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836585.721447:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770232704:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788836585.721501:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.721664:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.721694:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836585.721698:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836585.721702:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.721737:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.721752:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 7 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.721768:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8407:1875730782889472:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836585.721904:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836585.729079:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836585.729223:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8407:1875730782889472:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836585.729250:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.729320:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770232832 00000100:00100000:2.0:1788836585.729328:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770232832 00010000:00010000:2.0:1788836585.729367:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 8 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.729407:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:2.0:1788836585.729417:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770232832:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.729589:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.729614:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 8 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.729629:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 8 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.729653:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010efe21c/0xf7b38383a65548fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa457 expref: 8 pid: 8407 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.729672:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836585.729676:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836585.729698:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.729708:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.729740:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.729786:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770232832:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 370us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.729794:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00010000:00010000:3.0:1788836585.729848:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729857:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729878:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729886:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729894:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729909:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836585.729914:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729924:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729936:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.729944:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca957239/0xf7b38383a655491f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.730039:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770232704:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 8550us (9149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836585.730048:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:2.0:1788836585.735265:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.735333:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233088 00000100:00100000:1.0:1788836585.735343:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233088 00000100:00100000:1.0:1788836585.735396:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:1.0:1788836585.735405:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:11411:x1875730770233088:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788836585.735508:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.735526:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 16 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.735536:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.735597:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 16 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.735612:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 16 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.735626:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782889600:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836585.735713:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836585.738835:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.738934:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782889600:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836585.738959:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.739054:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233216 00000100:00100000:2.0:1788836585.739061:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233216 00010000:00010000:2.0:1788836585.739096:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 17 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.739127:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:2.0:1788836585.739137:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:2394:x1875730770233216:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.739152:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.739158:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 17 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739169:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 17 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739190:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6a00/0xf7b38383a6554815 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa403 expref: 17 pid: 10333 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739224:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.739231:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739241:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739248:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739255:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.739278:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.739329:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:2394:x1875730770233216:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 193us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.739337:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00010000:00010000:1.0:1788836585.739399:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739405:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739606:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739618:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739625:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739651:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.739672:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 16 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836585.739687:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782889728:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836585.739734:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7a7ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.743191:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.743318:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782889728:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836585.743343:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.743764:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233344 00000100:00100000:0.0:1788836585.743773:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233344 00010000:00010000:0.0:1788836585.743809:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 17 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836585.743858:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:0.0:1788836585.743866:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:2395:x1875730770233344:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836585.743882:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836585.743889:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 17 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743899:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 17 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743919:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7a00/0xf7b38383a65548e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa442 expref: 17 pid: 6492 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743932:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:0.0:1788836585.743937:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743946:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743953:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.743978:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836585.744072:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+16:2395:x1875730770233344:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 206us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.744080:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00010000:00010000:1.0:1788836585.744197:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.744204:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836585.744313:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788836585.744447:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788836585.744498:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788836585.744584:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782889856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836585.744633:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836585.744669:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836585.744771:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782889856 00000100:00100000:2.0:1788836585.744776:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782889856 00000100:00100000:2.0:1788836585.744814:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836585.744821:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875730782889856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836585.744890:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875730782889856:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.744895:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836585.744920:0:6491:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788836585.744925:0:6491:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788836585.744939:0:6491:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade4390bb80, transno 4294967310 00000100:00100000:2.0:1788836585.744961:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782889856:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788836585.745155:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788836585.745194:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782889984:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836585.745223:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836585.745238:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836585.746215:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782889984 00000100:00100000:1.0:1788836585.746224:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782889984 00000100:00100000:1.0:1788836585.746273:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836585.746283:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1875730782889984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836585.746441:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6491:x1875730782889984:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (1216us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788836585.746476:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788836585.746721:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782889984:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788836585.746764:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746774:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746781:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746796:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836585.746801:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746809:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746825:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:3.0:1788836585.746828:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836585.746833:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746839:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a655492d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746864:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746871:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746877:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746881:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f6800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836585.746884:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746890:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746907:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836585.746908:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836585.746916:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746926:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746935:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836585.746967:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.746980:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782890112:192.168.201.38@tcp:105: 00000100:00100000:3.0:1788836585.747092:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.750406:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.750484:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233472 00000100:00100000:0.0:1788836585.750506:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233472 00000100:00100000:0.0:1788836585.750565:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:0.0:1788836585.750583:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11410:x1875730770233472:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:0.0:1788836585.750706:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:11410:x1875730770233472:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 124us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.750714:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1788836585.750883:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782890112:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788836585.750908:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750917:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6800/0xf7b38383a6554870 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750949:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750962:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750972:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750980:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750987:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750993:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.750998:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836585.751052:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751060:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751072:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.751075:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836585.751078:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751084:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554934 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751094:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751101:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751106:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751111:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836585.751113:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751118:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751125:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.751128:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836585.751137:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.751143:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554926 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.751261:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11411:x1875730770233088:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 15857us (16006us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788836585.751270:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000020:00080000:2.0:1788836585.751273:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788836585.751398:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836585.751402:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836585.751909:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788836585.751919:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836585.754951:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.755172:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233728 00000100:00100000:0.0:1788836585.755183:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233728 00000100:00100000:0.0:1788836585.755234:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:0.0:1788836585.755243:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11410:x1875730770233728:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:0.0:1788836585.755441:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788836585.755761:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11410:x1875730770233728:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 518us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836585.755770:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:3.0:1788836585.762683:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836585.762928:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770233984 00000100:00100000:0.0:1788836585.762939:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770233984 00000100:00100000:0.0:1788836585.762998:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1788836585.763140:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:11411:x1875730770233984:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788836585.763389:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788836585.763437:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788836585.763485:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763502:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763512:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763536:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763542:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763547:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836585.763559:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836585.763665:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:11411:x1875730770233984:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 529us (992us total) trans 4294967410 rc 0/0 00010000:00010000:2.0:1788836585.763717:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836585.763725:0:10309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.763732:0:10309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836585.763736:0:10309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.763743:0:10309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.763756:0:10309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:2.0:1788836585.763759:0:10309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788836585.763764:0:10309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.763769:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a655493b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.763781:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836585.763783:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836585.763785:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836585.776444:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000020:00080000:0.0:1788836585.776579:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788836585.800133:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.800319:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234112 00000100:00100000:2.0:1788836585.800333:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234112 00000100:00100000:2.0:1788836585.800392:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:2.0:1788836585.800403:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:11413:x1875730770234112:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836585.800427:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836585.800449:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa45e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800516:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800531:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800543:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800558:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800565:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800607:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800688:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800699:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 22 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800724:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800757:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 22 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.800770:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 22 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.800783:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782890240:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836585.800878:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836585.804353:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836585.804456:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234368 00000100:00100000:1.0:1788836585.804474:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234368 00000100:00100000:1.0:1788836585.804538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:1.0:1788836585.804548:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:6168:x1875730770234368:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836585.804781:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:6168:x1875730770234368:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 233us (437us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788836585.804788:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788836585.805554:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782890240:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836585.805588:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836585.810518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836585.810768:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234496 00000100:00100000:2.0:1788836585.810779:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234496 00010000:00010000:2.0:1788836585.810820:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 24 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836585.810858:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:2.0:1788836585.810868:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:2395:x1875730770234496:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836585.810883:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836585.810890:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 24 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.810921:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 24 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.810944:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6000/0xf7b38383a6554862 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa41f expref: 24 pid: 12185 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.810960:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:2.0:1788836585.810966:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.810975:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.810983:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836585.811060:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836585.811111:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2395:x1875730770234496:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 244us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836585.811120:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00010000:00010000:1.0:1788836585.811886:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.811898:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836585.811954:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788836585.811959:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836585.811980:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812005:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812042:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812064:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812071:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812077:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.812081:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812089:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812101:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836585.812104:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.812108:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812114:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554949 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812128:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812134:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812140:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812145:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836585.812155:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812162:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812171:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adf785f7c00) 00010000:00010000:1.0:1788836585.812174:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836585.812177:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812183:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812395:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa45e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812413:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa45e expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836585.812430:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836585.812433:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836585.812435:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030400, rc 0) 00000100:00100000:1.0:1788836585.812604:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11413:x1875730770234112:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 12202us (12480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836585.812612:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00010000:00010000:1.0:1788836585.855073:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836586.239152:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836586.239175:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836586.239245:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836586.240033:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782890368 00000100:00100000:2.0:1788836586.240043:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782890368 00000100:00100000:2.0:1788836586.240106:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788836586.240115:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782890368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836586.240145:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788836586.240199:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782890368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836586.240217:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788836586.240267:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836586.245279:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836586.245302:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782890496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836586.245399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836586.245470:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782890496 00000100:00100000:3.0:1788836586.245478:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782890496 00000100:00100000:3.0:1788836586.245535:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788836586.245544:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782890496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836586.245580:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788836586.245628:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782890496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836586.245635:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788836586.245656:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836586.245701:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782890496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836586.433284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836586.433369:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234752 00000100:00100000:1.0:1788836586.433379:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234752 00000100:00100000:1.0:1788836586.433465:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 306 00000100:00100000:1.0:1788836586.433485:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2395:x1875730770234752:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836586.433573:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2395:x1875730770234752:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836586.433581:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 306 00000100:00080000:3.0:1788836586.434171:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836586.435459:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.435506:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.435533:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.435566:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.435597:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234880 00000100:00100000:3.0:1788836586.435606:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234880 00000100:00100000:3.0:1788836586.435652:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235392 00000100:00100000:3.0:1788836586.435656:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235392 00000100:00100000:3.0:1788836586.435678:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 307 00000100:00100000:3.0:1788836586.435688:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770234880:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836586.435746:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770234880:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836586.435754:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 307 00000100:00100000:3.0:1788836586.435769:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 308 00000100:00100000:3.0:1788836586.435786:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770235392:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836586.435816:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770235392:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836586.435823:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 308 00000100:00080000:3.0:1788836586.435842:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836586.436483:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770234624 00000100:00100000:1.0:1788836586.436489:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770234624 00000100:00100000:1.0:1788836586.436526:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 387 00000100:00100000:1.0:1788836586.436534:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770234624:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836586.436583:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770234624:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 50us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836586.436590:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 387 00000100:00100000:1.0:1788836586.436638:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235136 00000100:00100000:1.0:1788836586.436643:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235136 00000100:00100000:1.0:1788836586.436677:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1788836586.436684:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770235136:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836586.436714:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770235136:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836586.436720:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00080000:1.0:1788836586.436743:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836586.439453:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.439498:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836586.439576:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235264 00000100:00100000:2.0:1788836586.439586:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235264 00000100:00100000:2.0:1788836586.439658:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 309 00000100:00100000:2.0:1788836586.439667:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770235264:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836586.439736:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770235264:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836586.439744:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 309 00000100:00100000:1.0:1788836586.439882:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235008 00000100:00100000:1.0:1788836586.439887:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235008 00000100:00100000:1.0:1788836586.439925:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:1.0:1788836586.439934:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770235008:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836586.439968:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770235008:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 36us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836586.439996:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00080000:3.0:1788836586.440333:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836586.440338:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788836586.553906:0:14300:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836586.553915:0:14300:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836586.553947:0:14300:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788836586.553954:0:14300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788836586.814416:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836586.814424:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836586.814454:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788836586.814465:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836586.814604:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782890624:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836586.816767:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836586.821673:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782890624:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836586.836418:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.836721:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235520 00000100:00100000:3.0:1788836586.836732:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235520 00000100:00100000:3.0:1788836586.836797:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:3.0:1788836586.836808:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11426:x1875730770235520:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836586.836845:0:10333:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836586.836980:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11426:x1875730770235520:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 165us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836586.836991:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:2.0:1788836586.842826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836586.842900:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770235776 00000100:00100000:1.0:1788836586.842920:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770235776 00000100:00100000:1.0:1788836586.842994:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:1.0:1788836586.843005:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:11426:x1875730770235776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836586.843088:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836586.843114:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a655495e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa465 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.843223:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.843239:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.843253:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836586.843265:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788836586.843388:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a655495e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa465 expref: 25 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.843409:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa465 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.843417:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836586.843420:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836586.843424:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea800, rc 0) 00000100:00100000:1.0:1788836586.843495:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:11426:x1875730770235776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 492us (678us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788836586.843503:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1788836586.847484:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836586.852574:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236032 00000100:00100000:1.0:1788836586.852591:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236032 00000100:00100000:1.0:1788836586.852662:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:1.0:1788836586.852674:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:11426:x1875730770236032:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788836586.852756:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.852776:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.852788:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.852958:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.852967:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.853000:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.853006:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eac00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836586.853030:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.853039:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.853263:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836586.853267:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836586.853273:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836586.853282:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a6554973 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836586.853418:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:11426:x1875730770236032:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 745us (5942us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788836586.853427:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000040:00080000:3.0:1788836586.854190:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836586.854196:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836586.854701:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788836586.854712:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836586.855455:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836586.855874:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236160 00000100:00100000:3.0:1788836586.855884:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236160 00000100:00100000:2.0:1788836586.856677:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836586.856954:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236416 00000100:00100000:1.0:1788836586.856961:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236416 00000100:00100000:1.0:1788836586.857038:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788836586.857048:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:11426:x1875730770236416:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788836586.857632:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:11426:x1875730770236416:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 584us (957us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788836586.857655:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1788836586.858468:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788836586.858482:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:2394:x1875730770236160:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836586.858495:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836586.858528:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa465 expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836586.858558:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:3.0:1788836586.858564:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836586.858606:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:2394:x1875730770236160:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 129us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836586.858613:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00010000:00010000:0.0:1788836586.880874:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836587.264464:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836587.264554:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836587.264735:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782890752 00000100:00100000:1.0:1788836587.264744:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782890752 00000100:00100000:1.0:1788836587.264797:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788836587.264806:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782890752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836587.264839:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788836587.264911:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782890752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836587.264919:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788836587.265030:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836587.774717:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782891008:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.774791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.774851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782891520:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.774876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.774893:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782892032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.774914:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.774945:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836587.774951:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782891136:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.774979:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775002:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782891648:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775081:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782892160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775101:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775132:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782890880:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775163:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775186:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782891392:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775206:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775220:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782891904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775239:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775258:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788836587.775265:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5076ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782891264:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775303:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775324:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782891776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775343:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775358:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775376:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836587.775406:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782890880 00000100:00100000:0.0:1788836587.775414:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782890880 00000100:00100000:0.0:1788836587.775455:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788836587.775463:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775510:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782890880:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775517:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788836587.775561:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891008 00000100:00100000:0.0:1788836587.775566:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891008 00000100:00100000:0.0:1788836587.775592:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891520 00000100:00100000:0.0:1788836587.775595:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891520 00000100:00100000:0.0:1788836587.775613:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892032 00000100:00100000:0.0:1788836587.775615:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892032 00000100:00100000:0.0:1788836587.775626:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891136 00000100:00100000:0.0:1788836587.775629:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891136 00000100:00100000:0.0:1788836587.775637:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891392 00000100:00100000:0.0:1788836587.775639:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891392 00000100:00100000:0.0:1788836587.775647:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891904 00000100:00100000:0.0:1788836587.775649:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891904 00000100:00100000:0.0:1788836587.775663:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788836587.775668:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775707:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782891008:12345-0@lo:400:kworker.0 Request processed in 39us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775714:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788836587.775728:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788836587.775735:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775763:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782891520:12345-0@lo:400:kworker.0 Request processed in 29us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775768:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788836587.775780:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788836587.775786:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782892032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775812:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782892032:12345-0@lo:400:kworker.0 Request processed in 27us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775818:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788836587.775829:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788836587.775835:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782891136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775863:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782891136:12345-0@lo:400:kworker.0 Request processed in 28us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775875:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788836587.775888:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788836587.775893:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782891392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775922:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782891392:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775928:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788836587.775939:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788836587.775944:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.775970:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782891904:12345-0@lo:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.775975:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788836587.775993:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891264 00000100:00100000:0.0:1788836587.775997:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891264 00000100:00100000:0.0:1788836587.776041:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836587.776048:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782891264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776081:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782891264:12345-0@lo:400:kworker.0 Request processed in 34us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.776087:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836587.776105:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891648 00000100:00100000:0.0:1788836587.776109:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891648 00000100:00100000:0.0:1788836587.776126:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892160 00000100:00100000:0.0:1788836587.776129:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892160 00000100:00100000:0.0:1788836587.776142:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782891776 00000100:00100000:0.0:1788836587.776144:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782891776 00000100:00100000:0.0:1788836587.776156:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892288 00000100:00100000:0.0:1788836587.776158:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892288 00000100:00100000:0.0:1788836587.776170:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788836587.776184:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782891648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776215:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782891648:12345-0@lo:400:kworker.0 Request processed in 33us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.776222:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788836587.776235:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788836587.776241:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776267:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782892160:12345-0@lo:400:kworker.0 Request processed in 26us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.776272:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788836587.776283:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788836587.776288:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3615:x1875730782891776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776313:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3615:x1875730782891776:12345-0@lo:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.776319:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788836587.776330:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788836587.776336:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776361:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782892288:12345-0@lo:400:kworker.0 Request processed in 26us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836587.776366:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788836587.776403:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782891264:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776415:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782891776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776424:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776430:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782890880:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776449:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5076f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782891392:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776457:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782891904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776493:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782891136:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776501:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782891648:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776509:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782892160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836587.776518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782891008:0@lo:400:kworker.0 00010000:00080000:0.0:1788836587.776530:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a7af100 x1875730782891520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836587.776559:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782891520:0@lo:400:kworker.0 00010000:00080000:0.0:1788836587.776569:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4455ad80 x1875730782892032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836587.776577:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782892032:0@lo:400:kworker.0 00000004:00080000:1.0:1788836587.776996:0:10026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371682982185ns, next at 372682979838ns, rc = 0 00000100:00100000:1.0:1788836587.777056:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836587.777067:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836587.777106:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836587.777134:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892416 00000100:00100000:1.0:1788836587.777138:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892416 00000100:00100000:1.0:1788836587.777164:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836587.777170:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782892416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836587.777190:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836587.777221:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782892416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836587.777226:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836587.777255:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782892416:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788836587.779162:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836587.779171:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836587.779174:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836587.779176:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788836587.902200:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836588.297548:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5071ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782892544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836588.297620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836588.297740:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892544 00000100:00100000:1.0:1788836588.297747:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892544 00000100:00100000:1.0:1788836588.297800:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788836588.297808:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782892544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836588.297841:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836588.297887:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782892544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836588.297894:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788836588.297976:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5071ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782892544:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788836588.511864:0:14352:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836588.511872:0:14352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836588.511901:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788836588.511907:0:14352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836588.819362:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836588.819479:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236672 00000100:00100000:0.0:1788836588.819490:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236672 00000100:00100000:0.0:1788836588.819598:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:0.0:1788836588.819611:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:11446:x1875730770236672:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836588.819637:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836588.819674:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655497a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa46c expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.819822:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554981 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.819839:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.819852:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836588.819864:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788836588.820132:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a655497a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa46c expref: 28 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.820155:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554981 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa46c expref: 27 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.820163:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836588.820167:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788836588.820170:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173600, rc 0) 00000100:00100000:0.0:1788836588.820239:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:11446:x1875730770236672:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 631us (887us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788836588.820246:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00080000:3.0:1788836588.820465:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836588.826255:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836588.826330:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236800 00000100:00100000:0.0:1788836588.826341:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236800 00000100:00100000:0.0:1788836588.826406:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:0.0:1788836588.826416:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:11446:x1875730770236800:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788836588.826501:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826534:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826545:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826581:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826588:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826595:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826601:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836588.826605:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826612:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826623:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:0.0:1788836588.826626:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836588.826630:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.826636:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173000/0xf7b38383a655498f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836588.826719:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:11446:x1875730770236800:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 304us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836588.826726:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 146 00010000:00010000:1.0:1788836588.927297:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836588.968616:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836588.968998:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770236928 00000100:00100000:0.0:1788836588.969039:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770236928 00000100:00100000:0.0:1788836588.969123:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788836588.969134:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2397:x1875730770236928:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788836588.969153:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836588.969176:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bca264e/0xf7b38383a6554996 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa473 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836588.969203:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7ae9, atime: 0x6a9f7ae8, ctime: 0x6a9f7ae9, blocks: 0x8 00010000:00010000:0.0:1788836588.969226:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788836588.969231:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836588.969241:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bca264e/0xf7b38383a6554996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa473 expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.969259:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bca264e/0xf7b38383a6554996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa473 expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836588.969274:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82173000, rc 0) 00000100:00100000:0.0:1788836588.969342:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2397:x1875730770236928:12345-192.168.201.38@tcp:101:cat.0 Request processed in 211us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836588.969350:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00080000:3.0:1788836588.970124:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836588.981392:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836588.981648:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237056 00000100:00100000:1.0:1788836588.981662:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237056 00002000:00100000:1.0:1788836588.981736:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ade439f0e00 x1875730770237056/t0(0) o3->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:754/0 lens 488/0 e 0 to 0 dl 1788836599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836588.981748:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439f0e00 with x1875730770237056 ext(0->4095) 00002000:00010000:1.0:1788836588.981755:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade439f0e00 00000100:00100000:1.0:1788836588.982588:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1788836588.982612:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770237056:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:1.0:1788836588.982909:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770237056:12345-192.168.201.38@tcp:3:cat.0 Request processed in 306us (1530us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788836588.982920:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00002000:00100000:1.0:1788836588.982934:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ade439f0e00 x1875730770237056/t0(0) o3->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:754/0 lens 488/4536 e 0 to 0 dl 1788836599 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836588.982956:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439f0e00 with x1875730770237056 ext(0->4095) 00002000:00010000:1.0:1788836588.982962:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade439f0e00 00010000:00010000:0.0:1788836589.950141:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836590.334485:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782892672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836590.334609:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836590.334992:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892672 00000100:00100000:2.0:1788836590.335006:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892672 00000100:00100000:2.0:1788836590.335104:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836590.335115:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782892672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836590.335184:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836590.335319:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782892672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836590.335329:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788836590.338807:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782892672:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788836590.406580:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788836590.852755:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:2.0:1788836590.852778:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788836590.852827:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adf65c45000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788836590.852833:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf7852f600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adf65c45600 00000020:00080000:2.0:1788836590.852836:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf7852f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade439b4000 00000020:00080000:2.0:1788836590.852862:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788836590.852877:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788836590.852986:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788836590.853129:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836590.853159:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788836590.853259:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836590.853362:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892800 00000100:00100000:1.0:1788836590.853372:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892800 00000100:00100000:1.0:1788836590.853449:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836590.853461:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782892800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788836590.853621:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788836590.853625:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788836585 -> 1788836585 00002000:00010000:1.0:1788836590.853627:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788836584 -> 1788836584 00002000:00010000:1.0:1788836590.853629:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788836585 -> 1788836585 00002000:00010000:1.0:1788836590.853631:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788836590.853676:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3615:x1875730782892800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (417us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788836590.853684:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788836590.853711:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788836590.853753:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adf5071ce00/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788836590.853760:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892800:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788836590.854037:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854049:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854057:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854064:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836590.854070:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854079:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854103:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ade438f2800) 00010000:00010000:0.0:1788836590.854106:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836590.854112:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836590.854119:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554911 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836590.854509:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788836590.854521:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788836590.854624:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:2.0:1788836590.975222:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836590.976226:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836590.976235:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836590.976260:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788836590.976269:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836591.358458:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836591.358617:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836591.358936:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782892928 00000100:00100000:3.0:1788836591.358948:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782892928 00000100:00100000:3.0:1788836591.359054:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788836591.359067:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782892928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836591.359109:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788836591.359173:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782892928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.359180:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788836591.359224:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788836591.359231:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788836591.359261:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade44555880, transno 4294967305 00000100:00100000:3.0:1788836591.359294:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782892928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788836591.359508:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836591.359741:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782893056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836591.359786:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836591.359886:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893056 00000100:00100000:1.0:1788836591.359891:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893056 00000100:00100000:1.0:1788836591.359954:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836591.359963:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782893056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836591.359980:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836591.360048:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782893056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836591.360055:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836591.360106:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782893056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836591.360268:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836591.561501:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836591.561563:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836591.561595:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836591.561632:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836591.561639:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237312 00000100:00100000:1.0:1788836591.561658:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237312 00000100:00100000:2.0:1788836591.561659:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836591.561690:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836591.561722:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836591.561874:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237568 00000100:00100000:2.0:1788836591.561881:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237696 00000100:00100000:0.0:1788836591.561881:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237568 00000100:00100000:2.0:1788836591.561909:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237696 00000100:00100000:1.0:1788836591.566955:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237824 00000100:00100000:1.0:1788836591.566981:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237824 00000100:00100000:0.0:1788836591.567636:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:0.0:1788836591.567655:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770237568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836591.567774:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770237568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 125us (6211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836591.567783:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:0.0:1788836591.567807:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:0.0:1788836591.567815:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770237696:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836591.567844:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770237696:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 30us (6156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836591.567851:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:3.0:1788836591.572527:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237440 00000100:00100000:3.0:1788836591.572543:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237440 00000100:00100000:3.0:1788836591.572620:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237952 00000100:00100000:3.0:1788836591.572624:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237952 00000100:00100000:3.0:1788836591.572651:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 316 00000100:00100000:3.0:1788836591.572662:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:2394:x1875730770237312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836591.572746:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:2394:x1875730770237312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 85us (11256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.572753:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 316 00000100:00100000:3.0:1788836591.572777:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 317 00000100:00100000:3.0:1788836591.572784:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770237824:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836591.572806:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770237824:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (11211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.572812:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 317 00000100:00100000:3.0:1788836591.572823:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 318 00000100:00100000:3.0:1788836591.572829:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770237440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836591.572849:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770237440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 20us (11194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.572854:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 318 00000100:00100000:3.0:1788836591.572864:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 319 00000100:00100000:3.0:1788836591.572870:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770237952:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836591.572889:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770237952:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 20us (11167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.572923:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 319 00000100:00100000:3.0:1788836591.572951:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770237184 00000100:00100000:3.0:1788836591.572955:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770237184 00000100:00100000:3.0:1788836591.573506:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 389 00000100:00100000:3.0:1788836591.573515:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770237184:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836591.573548:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770237184:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (11915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836591.573556:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 389 00000100:00080000:3.0:1788836591.573589:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836591.573594:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836591.573597:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836591.573600:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836591.998210:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836592.382355:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782893184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836592.382440:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836592.382550:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893184 00000100:00100000:1.0:1788836592.382558:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893184 00000100:00100000:1.0:1788836592.382611:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788836592.382621:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782893184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836592.382655:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788836592.382706:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782893184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836592.382714:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788836592.382757:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782893184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836592.894329:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836592.894362:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782893312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836592.894471:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836592.894556:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893312 00000100:00100000:1.0:1788836592.894564:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893312 00000100:00100000:1.0:1788836592.894621:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788836592.894630:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782893312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836592.894660:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836592.894705:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782893312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836592.894712:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788836592.894767:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788836592.894781:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788836592.894808:0:3615:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adf5071ce00 x1875730782892800/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788836606 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836592.894825:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782893312:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788836592.895033:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836592.895722:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782893568:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.895797:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782894080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.895834:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782894592:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895854:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.895884:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836592.895891:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782893696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895914:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.895929:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782894208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.895967:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782894720:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.895998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836592.896056:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893568 00000100:00100000:3.0:1788836592.896062:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893568 00000100:00100000:3.0:1788836592.896097:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894080 00000100:00100000:3.0:1788836592.896100:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894080 00000100:00100000:3.0:1788836592.896120:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894592 00000100:00100000:3.0:1788836592.896123:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894592 00000100:00100000:3.0:1788836592.896135:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893696 00000100:00100000:3.0:1788836592.896138:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893696 00000100:00100000:3.0:1788836592.896150:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788836592.896156:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782893568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782893568:12345-0@lo:400:kworker.0 Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896208:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788836592.896222:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788836592.896228:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782894080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896258:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782894080:12345-0@lo:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896264:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788836592.896276:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788836592.896281:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782894592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896303:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782894592:12345-0@lo:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896308:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788836592.896319:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788836592.896345:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782893696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896372:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782893696:12345-0@lo:400:kworker.0 Request processed in 49us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896383:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788836592.896404:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894208 00000100:00100000:3.0:1788836592.896408:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894208 00000100:00100000:3.0:1788836592.896426:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894720 00000100:00100000:3.0:1788836592.896428:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894720 00000100:00100000:3.0:1788836592.896455:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788836592.896461:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782894208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896492:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782894208:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896498:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788836592.896508:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788836592.896514:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896540:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782894720:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.896545:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788836592.896563:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836592.896567:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836592.896591:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782893696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896600:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782894208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896609:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782894720:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.896617:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782893568:0@lo:400:kworker.0 00010000:00080000:3.0:1788836592.896627:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436fbb80 x1875730782894080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836592.896636:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782894080:0@lo:400:kworker.0 00010000:00080000:3.0:1788836592.896655:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44504000 x1875730782894592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836592.896663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782894592:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897004:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782893824:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897075:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836592.897096:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782894336:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897116:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836592.897144:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788836592.897151:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782893440:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897177:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836592.897205:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782893952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897231:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836592.897248:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782894464:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897266:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836592.897291:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893952 00000100:00100000:0.0:1788836592.897296:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893952 00000100:00100000:0.0:1788836592.897346:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894464 00000100:00100000:0.0:1788836592.897349:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894464 00000100:00100000:0.0:1788836592.897365:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788836592.897371:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897415:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782893952:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836592.897421:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788836592.897435:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788836592.897441:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897478:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782894464:12345-0@lo:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836592.897484:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:0.0:1788836592.897501:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836592.897509:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894336 00000100:00100000:0.0:1788836592.897513:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894336 00000100:00100000:0.0:1788836592.897534:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836592.897540:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782894336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897567:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782894336:12345-0@lo:400:kworker.0 Request processed in 28us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836592.897573:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836592.897600:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782893952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897619:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782894464:0@lo:400:kworker.0 00000100:00100000:0.0:1788836592.897627:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782894336:0@lo:400:kworker.0 00000100:00100000:1.0:1788836592.897925:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893440 00000100:00100000:1.0:1788836592.897930:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893440 00000100:00100000:1.0:1788836592.897967:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788836592.897975:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782893440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836592.898037:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782893440:12345-0@lo:400:kworker.0 Request processed in 64us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836592.898044:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788836592.898080:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf8155c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782893440:0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.898976:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782893824 00000100:00100000:3.0:1788836592.898983:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782893824 00000100:00100000:3.0:1788836592.899060:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788836592.899069:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782893824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836592.899125:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782893824:12345-0@lo:400:kworker.0 Request processed in 59us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836592.899131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788836592.899223:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782893824:0@lo:400:kworker.0 00010000:00010000:0.0:1788836593.022189:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836593.406213:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836593.406236:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782894848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836593.406313:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836593.406450:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894848 00000100:00100000:0.0:1788836593.406459:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894848 00000100:00100000:0.0:1788836593.406511:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836593.406521:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782894848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836593.406543:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788836593.406592:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782894848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836593.406599:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836593.406804:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782894848:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788836594.046257:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836594.493185:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836594.493288:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238080 00000100:00100000:0.0:1788836594.493298:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238080 00000100:00100000:0.0:1788836594.493396:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:0.0:1788836594.493408:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11091:x1875730770238080:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788836594.493544:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11091:x1875730770238080:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836594.493552:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00080000:3.0:1788836594.493630:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836594.496817:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836594.498501:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238208 00000100:00100000:0.0:1788836594.498518:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238208 00000100:00100000:0.0:1788836594.498621:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:0.0:1788836594.498636:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:11091:x1875730770238208:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788836594.498763:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:11091:x1875730770238208:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 131us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836594.498789:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00080000:3.0:1788836594.499456:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836594.502752:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836594.503072:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238464 00000100:00100000:1.0:1788836594.503083:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238464 00000100:00100000:1.0:1788836594.503149:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788836594.503160:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:11091:x1875730770238464:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788836594.503440:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:11091:x1875730770238464:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 279us (696us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788836594.503447:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788836594.843990:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836594.844250:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238592 00000100:00100000:1.0:1788836594.844262:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238592 00000100:00080000:3.0:1788836594.844636:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836594.844689:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:1.0:1788836594.844702:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:11905:x1875730770238592:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:1.0:1788836594.844746:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836594.844774:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a655499d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa47a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.844862:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.844877:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.845168:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836594.845220:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788836594.845224:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836594.845268:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.845377:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a655499d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.845399:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836594.845408:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:1.0:1788836594.845452:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836594.845456:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eba00, rc 0) 00000100:00100000:1.0:1788836594.845646:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+6:11905:x1875730770238592:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 945us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836594.845654:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00010000:00010000:1.0:1788836595.070366:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836595.456194:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782894976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836595.456278:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836595.456897:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782894976 00000100:00100000:2.0:1788836595.456907:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782894976 00000100:00100000:2.0:1788836595.456963:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836595.456974:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782894976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836595.457039:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836595.457102:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782894976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836595.457110:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788836595.457204:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782894976:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788836596.094180:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836596.478514:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836596.478537:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782895104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836596.478606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836596.478792:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895104 00000100:00100000:1.0:1788836596.478802:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895104 00000100:00080000:0.0:1788836596.478934:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836596.478987:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788836596.478999:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782895104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836596.479065:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836596.479449:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782895104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 452us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836596.479457:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788836596.492704:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836596.492734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782895232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836596.492825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836596.493233:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895232 00000100:00100000:0.0:1788836596.493242:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895232 00000100:00100000:0.0:1788836596.493311:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788836596.493321:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782895232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836596.493344:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836596.493405:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782895232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836596.493413:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1788836596.493479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836596.493794:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782895232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836596.495744:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782895104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836596.683985:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836596.684083:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238848 00000100:00100000:3.0:1788836596.684095:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836596.684095:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238848 00000100:00100000:3.0:1788836596.684123:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836596.684148:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239104 00000100:00100000:0.0:1788836596.684153:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239104 00000100:00100000:3.0:1788836596.684172:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836596.684177:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239360 00000100:00100000:1.0:1788836596.684181:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239360 00000100:00100000:0.0:1788836596.684193:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:1.0:1788836596.684204:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 326 00000100:00100000:0.0:1788836596.684205:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770239104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.684212:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836596.684214:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2395:x1875730770238848:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.684240:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836596.684291:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770239104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836596.684300:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1788836596.684317:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239232 00000100:00100000:0.0:1788836596.684334:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239232 00000100:00100000:0.0:1788836596.684361:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:0.0:1788836596.684367:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770239232:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.690520:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836596.690982:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238720 00000100:00100000:3.0:1788836596.690993:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238720 00000100:00100000:3.0:1788836596.691062:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 391 00000100:00100000:3.0:1788836596.691072:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770238720:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.691142:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770238720:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (6972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836596.691165:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 391 00000100:00080000:3.0:1788836596.691208:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836596.691213:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836596.691217:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836596.691228:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770238976 00000100:00100000:3.0:1788836596.691232:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770238976 00000100:00100000:3.0:1788836596.691264:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239488 00000100:00100000:3.0:1788836596.691268:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239488 00000100:00100000:3.0:1788836596.691284:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 327 00000100:00100000:3.0:1788836596.691291:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2395:x1875730770239360:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.691325:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2395:x1875730770239360:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (7202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836596.691331:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 327 00000100:00100000:3.0:1788836596.691346:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 328 00000100:00100000:3.0:1788836596.691352:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770238976:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.691376:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770238976:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (7169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836596.691395:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 328 00000100:00100000:3.0:1788836596.691407:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 329 00000100:00100000:3.0:1788836596.691414:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770239488:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836596.691440:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770239488:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836596.691445:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 329 00000100:00080000:3.0:1788836596.691460:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836596.697436:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770239232:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 13054us (13183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836596.697453:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:1.0:1788836596.703963:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2395:x1875730770238848:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 19738us (19974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836596.703981:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 326 00000001:00080000:0.0:1788836596.993864:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788836596.994386:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788836596.994407:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788836596.995036:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788836596.995065:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788836597.118364:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836597.502409:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782895360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836597.502478:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836597.502743:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895360 00000100:00100000:1.0:1788836597.502751:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895360 00000100:00100000:1.0:1788836597.502802:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788836597.502811:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782895360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836597.502842:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788836597.502971:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782895360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836597.502978:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788836597.507345:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782895360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836598.015750:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836598.017642:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782895616:0@lo:400:kworker.0 00000100:00100000:1.0:1788836598.017723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836598.017785:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836598.017792:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782895744:0@lo:400:kworker.0 00000100:00100000:1.0:1788836598.017821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836598.017859:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895616 00000100:00100000:1.0:1788836598.017866:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895616 00000100:00100000:1.0:1788836598.017913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788836598.017923:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782895616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836598.017987:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782895616:12345-0@lo:400:kworker.0 Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836598.017994:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788836598.018067:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782895616:0@lo:400:kworker.0 00000100:00100000:2.0:1788836598.018177:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895744 00000100:00100000:2.0:1788836598.018182:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895744 00000100:00100000:2.0:1788836598.018220:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788836598.018228:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782895744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836598.018267:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782895744:12345-0@lo:400:kworker.0 Request processed in 41us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836598.018273:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788836598.018565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782895744:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.018678:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782895872:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.018712:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836598.018742:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782895488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836598.018765:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836598.018840:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895872 00000100:00100000:2.0:1788836598.018844:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895872 00000100:00100000:2.0:1788836598.018880:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788836598.018887:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782895872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836598.018926:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782895872:12345-0@lo:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836598.018933:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788836598.019090:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782895872:0@lo:400:kworker.0 00000100:00100000:1.0:1788836598.019807:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782895488 00000100:00100000:1.0:1788836598.019815:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782895488 00000100:00100000:1.0:1788836598.019871:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788836598.019880:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782895488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836598.019907:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836598.019973:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782895488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836598.019980:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788836598.020122:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836598.020238:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788836598.020244:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adf5071ce00, transno 4294967313 00000100:00100000:0.0:1788836598.020269:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782895488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836598.023507:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782896128:0@lo:400:kworker.0 00000100:00100000:1.0:1788836598.023579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836598.023672:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782896000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836598.023707:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836598.023762:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896128 00000100:00100000:2.0:1788836598.023770:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896128 00000100:00100000:2.0:1788836598.023826:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788836598.023836:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782896128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.024311:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782896256:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.024343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836598.024389:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896000 00000100:00100000:0.0:1788836598.024393:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896000 00000100:00100000:0.0:1788836598.024421:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788836598.024428:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782896000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.024482:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782896000:12345-0@lo:400:kworker.0 Request processed in 54us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836598.024490:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788836598.024527:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782896000:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.024545:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896256 00000100:00100000:0.0:1788836598.024548:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896256 00000100:00100000:0.0:1788836598.024571:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788836598.024577:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.024622:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782896256:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836598.024628:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00080000:0.0:1788836598.024656:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44507800 x1875730782896256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836598.024667:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782896256:0@lo:400:kworker.0 00000100:00080000:0.0:1788836598.024689:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836598.024693:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836598.030466:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782896128:12345-0@lo:400:kworker.0 Request processed in 6618us (6874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836598.030482:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788836598.030720:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782896768:0@lo:400:kworker.0 00000100:00100000:3.0:1788836598.030783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836598.030813:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836598.030819:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782896640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836598.030842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836598.030871:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896768 00000100:00100000:3.0:1788836598.030878:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896768 00000100:00100000:3.0:1788836598.030924:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896640 00000100:00100000:3.0:1788836598.030928:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896640 00000100:00100000:3.0:1788836598.030951:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788836598.030975:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782896768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836598.031046:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782896768:12345-0@lo:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836598.031052:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788836598.031066:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788836598.031072:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782896640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836598.031100:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782896640:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836598.031106:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788836598.031331:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782896384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031377:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836598.031399:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782896896:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031421:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836598.031443:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836598.031449:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782896512:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031467:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836598.031493:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896384 00000100:00100000:0.0:1788836598.031497:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896384 00000100:00100000:0.0:1788836598.031540:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896896 00000100:00100000:0.0:1788836598.031543:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896896 00000100:00100000:0.0:1788836598.031556:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782896512 00000100:00100000:0.0:1788836598.031559:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782896512 00000100:00100000:0.0:1788836598.031571:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836598.031577:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782896384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031615:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782896384:12345-0@lo:400:kworker.0 Request processed in 38us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836598.031622:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836598.031635:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836598.031641:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782896896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031675:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782896896:12345-0@lo:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836598.031680:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836598.031690:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836598.031696:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782896512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031721:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782896512:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836598.031727:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788836598.031761:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782896512:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031771:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782896384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031778:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782896896:0@lo:400:kworker.0 00000100:00100000:0.0:1788836598.031854:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782896640:0@lo:400:kworker.0 00010000:00080000:0.0:1788836598.031867:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44505180 x1875730782896768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836598.031891:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782896768:0@lo:400:kworker.0 00000100:00080000:3.0:1788836598.035083:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836598.035098:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836598.035101:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836598.035104:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836598.037394:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782896128:0@lo:400:kworker.0 00010000:00010000:1.0:1788836598.142396:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836598.526329:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836598.526363:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782897024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836598.526446:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836598.532839:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897024 00000100:00100000:1.0:1788836598.532855:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897024 00000100:00100000:1.0:1788836598.533216:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788836598.533228:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782897024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836598.533263:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836598.533374:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782897024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (6928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836598.533386:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836598.533508:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782897024:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836599.166324:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836599.374223:0:14549:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:03:17 (1788836597) 00000040:00080000:3.0:1788836600.190268:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836600.190295:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836600.190418:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788836600.190426:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788836600.191055:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836600.574369:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836600.574396:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782897152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836600.574470:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836600.574594:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897152 00000100:00100000:2.0:1788836600.574603:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897152 00000100:00100000:2.0:1788836600.574664:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788836600.574675:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782897152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836600.574717:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836600.574773:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782897152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836600.574781:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788836600.575058:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782897152:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788836600.638938:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836600.973473:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836600.973580:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239744 00000100:00100000:1.0:1788836600.973590:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239744 00000100:00100000:1.0:1788836600.973667:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:1.0:1788836600.973677:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:12172:x1875730770239744:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836600.973707:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836600.973729:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a65549ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa481 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973802:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973816:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973826:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973860:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973868:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973875:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973965:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a65549c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973974:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a65549c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.973981:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a65549c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836600.973989:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788836600.974110:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974118:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974125:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974131:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836600.974135:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974154:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974166:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ade43819a00) 00010000:00010000:1.0:1788836600.974169:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836600.974174:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974180:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a65549b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974195:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974201:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974207:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974212:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836600.974215:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974220:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974226:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ade438f2400) 00010000:00010000:1.0:1788836600.974229:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836600.974232:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.974247:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a65549b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.975145:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a65549ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa481 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.975166:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a65549c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa481 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836600.975191:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:1.0:1788836600.975195:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836600.975198:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea800, rc 0) 00000100:00100000:1.0:1788836600.975271:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:12172:x1875730770239744:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1595us (1808us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788836600.975280:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00080000:3.0:1788836600.975721:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836600.984500:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836600.984609:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836600.984721:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770239872 00000100:00100000:2.0:1788836600.984732:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770239872 00000100:00100000:2.0:1788836600.984798:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:2.0:1788836600.984809:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:12172:x1875730770239872:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788836600.984923:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:12172:x1875730770239872:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 115us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836600.984931:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:0.0:1788836600.995335:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240000 00000100:00100000:0.0:1788836600.995353:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240000 00000100:00100000:0.0:1788836600.995435:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1788836600.995447:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:2396:x1875730770240000:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836600.995465:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836600.995490:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a65549c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa481 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836600.995512:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:0.0:1788836600.995517:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836600.995588:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2396:x1875730770240000:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 144us (10978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836600.995596:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788836600.996348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836600.996849:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240128 00000100:00100000:0.0:1788836600.996857:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240128 00000100:00100000:0.0:1788836600.996916:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1788836600.996935:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:12172:x1875730770240128:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788836600.997047:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:12172:x1875730770240128:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 114us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836600.997055:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00080000:1.0:1788836600.997140:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788836601.214203:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836601.214212:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836601.214787:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788836601.214798:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788836601.219139:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836601.599116:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836601.599139:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782897408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836601.599208:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836601.599282:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782897280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836601.599318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836601.599367:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897408 00000100:00100000:2.0:1788836601.599374:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897408 00000100:00100000:2.0:1788836601.599424:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897280 00000100:00100000:2.0:1788836601.599426:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897280 00000100:00100000:2.0:1788836601.599446:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788836601.599454:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782897408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836601.599486:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836601.599528:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782897408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.599535:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788836601.599553:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788836601.599559:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782897280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836601.599569:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788836601.599577:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836601.599596:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782897280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.599602:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788836601.599645:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782897408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836601.599690:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782897280:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788836601.667381:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836601.791958:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792005:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792081:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792150:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792174:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792215:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836601.792244:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240384 00000100:00100000:2.0:1788836601.792253:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240384 00000100:00100000:2.0:1788836601.792310:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240896 00000100:00100000:2.0:1788836601.792314:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240896 00000100:00100000:2.0:1788836601.792338:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240512 00000100:00100000:2.0:1788836601.792341:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240512 00000100:00100000:2.0:1788836601.792364:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241024 00000100:00100000:2.0:1788836601.792367:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241024 00000100:00100000:2.0:1788836601.792387:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 336 00000100:00100000:2.0:1788836601.792396:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2396:x1875730770240384:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792466:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:2396:x1875730770240384:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792473:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 336 00000100:00100000:2.0:1788836601.792490:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 337 00000100:00100000:2.0:1788836601.792497:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2396:x1875730770240896:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792521:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2396:x1875730770240896:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792528:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 337 00000100:00100000:2.0:1788836601.792538:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 338 00000100:00100000:2.0:1788836601.792544:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770240512:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792567:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770240512:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792583:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 338 00000100:00100000:2.0:1788836601.792595:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 339 00000100:00100000:2.0:1788836601.792601:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770241024:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792627:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770241024:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792633:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 339 00000100:00100000:2.0:1788836601.792652:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240640 00000100:00100000:2.0:1788836601.792656:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240640 00000100:00100000:2.0:1788836601.792681:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240768 00000100:00100000:2.0:1788836601.792684:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240768 00000100:00100000:2.0:1788836601.792705:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1788836601.792711:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770240640:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792736:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770240640:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792742:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1788836601.792752:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:2.0:1788836601.792759:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770240768:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836601.792781:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2396:x1875730770240768:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836601.792786:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00080000:2.0:1788836601.792807:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836601.792811:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836601.792814:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836601.792816:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836601.792958:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770240256 00000100:00100000:3.0:1788836601.792963:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770240256 00000100:00100000:3.0:1788836601.792998:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 393 00000100:00100000:3.0:1788836601.793006:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770240256:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836601.793074:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770240256:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836601.793081:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 393 00010000:00010000:3.0:1788836602.238276:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836602.622561:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836602.622594:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782897536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836602.622698:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836602.622918:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897536 00000100:00100000:1.0:1788836602.622930:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897536 00000100:00100000:1.0:1788836602.623002:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788836602.623032:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782897536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836602.623093:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788836602.623159:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782897536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836602.623179:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788836602.623239:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782897536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836603.135295:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836603.135329:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836603.135442:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836603.135629:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897664 00000100:00100000:1.0:1788836603.135641:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897664 00000100:00100000:1.0:1788836603.135725:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788836603.135737:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782897664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836603.135775:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836603.135832:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782897664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.135840:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788836603.135897:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836603.135945:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836603.148610:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782897792:0@lo:400:kworker.0 00000100:00100000:0.0:1788836603.148732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.148880:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897792 00000100:00100000:2.0:1788836603.148907:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897792 00000100:00100000:2.0:1788836603.148978:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788836603.148989:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782897792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.153815:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782898048:0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.153933:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836603.154004:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836603.154041:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782897920:0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154072:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836603.154120:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782898176:0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154147:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836603.154209:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782897920 00000100:00100000:3.0:1788836603.154220:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782897920 00000100:00100000:3.0:1788836603.154287:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898176 00000100:00100000:3.0:1788836603.154291:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898176 00000100:00100000:3.0:1788836603.154314:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788836603.154324:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782897920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154533:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782897920:12345-0@lo:400:kworker.0 Request processed in 210us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836603.154542:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788836603.154561:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788836603.154568:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782898176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154602:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782898176:12345-0@lo:400:kworker.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836603.154608:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788836603.154653:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782897920:0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154766:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782898176:0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154827:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898048 00000100:00100000:3.0:1788836603.154831:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898048 00000100:00100000:3.0:1788836603.154863:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788836603.154870:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782898048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836603.154911:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782898048:12345-0@lo:400:kworker.0 Request processed in 42us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836603.154919:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788836603.154943:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782898048:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.155578:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3617:x1875730782897792:12345-0@lo:400:kworker.0 Request processed in 6586us (6841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.155591:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788836603.156126:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782898432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.156178:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836603.156204:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782898944:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.156227:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836603.156248:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836603.156253:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782898560:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.156288:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836603.156306:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782899072:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.156328:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836603.156359:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898432 00000100:00100000:1.0:1788836603.156367:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898432 00000100:00100000:2.0:1788836603.156493:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782898688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.156552:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782899200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156575:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.156592:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836603.156597:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782898304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.156642:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782898816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156662:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.156703:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898688 00000100:00100000:2.0:1788836603.156708:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898688 00000100:00100000:2.0:1788836603.156754:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782899200 00000100:00100000:2.0:1788836603.156757:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782899200 00000100:00100000:2.0:1788836603.156772:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898816 00000100:00100000:2.0:1788836603.156774:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898816 00000100:00100000:2.0:1788836603.156790:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836603.156797:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782898688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156853:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782898688:12345-0@lo:400:kworker.0 Request processed in 56us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.156860:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836603.156874:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788836603.156897:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782899200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156929:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782899200:12345-0@lo:400:kworker.0 Request processed in 34us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.156935:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788836603.156946:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788836603.156951:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782898816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.156978:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782898816:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.156984:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788836603.157005:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898304 00000100:00100000:2.0:1788836603.157008:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898304 00000100:00100000:2.0:1788836603.157059:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788836603.157065:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782898304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.157099:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782898304:12345-0@lo:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.157105:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788836603.157148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782898304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.157161:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782898816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.157171:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782898688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836603.157179:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782899200:0@lo:400:kworker.0 00000100:00080000:2.0:1788836603.157210:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836603.157216:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836603.157533:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898944 00000100:00100000:1.0:1788836603.157538:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898944 00000100:00100000:1.0:1788836603.157561:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782898560 00000100:00100000:1.0:1788836603.157565:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782898560 00000100:00100000:1.0:1788836603.157579:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782899072 00000100:00100000:1.0:1788836603.157583:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782899072 00000100:00100000:1.0:1788836603.157602:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788836603.157610:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782898432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.157668:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782898432:12345-0@lo:400:kworker.0 Request processed in 59us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.158600:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788836603.159191:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788836603.159210:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782898944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.159313:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782898944:12345-0@lo:400:kworker.0 Request processed in 112us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.159320:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788836603.159337:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788836603.159344:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782898560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.159376:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782898560:12345-0@lo:400:kworker.0 Request processed in 34us (3087us total) trans 0 rc 0/0 00000100:00080000:2.0:1788836603.159849:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836603.159856:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836603.159946:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788836603.159966:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788836603.159976:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782899072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.160059:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782899072:12345-0@lo:400:kworker.0 Request processed in 86us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.160066:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00080000:1.0:1788836603.160143:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44709f80 x1875730782898560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836603.160160:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782898560:0@lo:400:kworker.0 00010000:00080000:1.0:1788836603.160174:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4470aa00 x1875730782899072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836603.160182:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782899072:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.160213:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782898432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836603.160225:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782898944:0@lo:400:kworker.0 00000100:00100000:0.0:1788836603.161261:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782897792:0@lo:400:kworker.0 00010000:00010000:1.0:1788836603.262688:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836603.477612:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836603.477801:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241152 00000100:00100000:3.0:1788836603.477815:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241152 00000100:00100000:3.0:1788836603.477934:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:3.0:1788836603.477948:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:12215:x1875730770241152:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836603.477978:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836603.478007:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a65549ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa488 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478126:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478145:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478158:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478175:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478181:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478188:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478247:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478255:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478272:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478290:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836603.478295:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478304:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478320:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:3.0:1788836603.478323:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836603.478329:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478335:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a65549d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478350:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478356:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478362:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478367:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836603.478370:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478376:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478396:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adf439d0200) 00010000:00010000:3.0:1788836603.478398:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836603.478401:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478406:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a65549dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478442:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a65549ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa488 expref: 15 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478452:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:3.0:1788836603.478455:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836603.478459:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a65549ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa488 expref: 15 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.478469:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701e00, rc 0) 00000100:00100000:3.0:1788836603.478554:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:12215:x1875730770241152:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 608us (957us total) trans 0 rc 301/301 00000100:00100000:3.0:1788836603.478562:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00080000:2.0:1788836603.478871:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836603.490479:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836603.490561:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241408 00000100:00100000:1.0:1788836603.490575:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241408 00000100:00100000:1.0:1788836603.490654:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:1.0:1788836603.490665:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:12215:x1875730770241408:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:1.0:1788836603.490752:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836603.490787:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7200/0xf7b38383a6554322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2ac expref: 14 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.490808:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:1.0:1788836603.490814:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836603.490895:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.490911:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.490921:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.490964:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.490980:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 5 pid: 6491 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836603.491085:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782899328:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836603.491205:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836603.506112:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836603.506246:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782899328:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836603.506292:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836603.506389:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241536 00000100:00100000:0.0:1788836603.506399:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241536 00010000:00010000:0.0:1788836603.506473:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 6 pid: 6491 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836603.506520:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:0.0:1788836603.506533:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af47d36a-929f-4c54-b0ec-8b3068716457+6:2395:x1875730770241536:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836603.506554:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836603.506574:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 6 pid: 6491 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506589:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 6 pid: 6491 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506616:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a65549a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa47a expref: 6 pid: 6491 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506638:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:0.0:1788836603.506644:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506656:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506666:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.506705:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836603.506772:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770241536:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 241us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836603.506781:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00080000:2.0:1788836603.506981:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788836603.506997:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507005:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507064:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507075:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507082:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507977:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.507995:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508003:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836603.508051:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bb62ab1 reply state 0000000053e79286 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508066:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508080:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ade4273b500) 00010000:00010000:2.0:1788836603.508083:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836603.508088:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836603.508095:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788836603.508105:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508112:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508120:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508126:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836603.508132:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508141:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508152:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819d00) 00010000:00010000:2.0:1788836603.508155:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836603.508159:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508166:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a65549e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836603.508187:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bb62ab1 reply state 0000000053e79286 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508209:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.508216:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ade4273b400) 00010000:00010000:2.0:1788836603.508218:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836603.508220:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788836603.508341:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+15:12215:x1875730770241408:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 17674us (17873us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788836603.508351:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 154 00000001:00080000:3.0:1788836603.530037:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00010000:00010000:1.0:1788836603.530966:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.530988:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.530998:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531004:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836603.531028:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531038:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531063:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ade4273b400) 00010000:00010000:1.0:1788836603.531067:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836603.531074:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531080:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65549ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531106:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531112:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531135:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531139:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836603.531142:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531148:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531156:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ade4273b500) 00010000:00010000:1.0:1788836603.531159:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836603.531162:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.531168:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65549f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836603.625943:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836603.627052:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241664 00000100:00100000:1.0:1788836603.627068:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241664 00000100:00100000:1.0:1788836603.627142:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 155 00000100:00100000:1.0:1788836603.627153:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:12223:x1875730770241664:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:1.0:1788836603.627183:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836603.627213:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a65549f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa48f expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627305:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627322:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627343:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836603.627399:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788836603.627402:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836603.627428:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627456:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a65549f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa48f expref: 14 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627479:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa48f expref: 13 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.627488:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:1.0:1788836603.627491:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836603.627496:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eac00, rc 0) 00000100:00100000:1.0:1788836603.627576:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:12223:x1875730770241664:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 424us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.627585:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 155 00000100:00100000:0.0:1788836603.647228:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782899456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836603.647343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836603.647474:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782899456 00000100:00100000:2.0:1788836603.647485:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782899456 00000100:00100000:2.0:1788836603.647562:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836603.647574:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782899456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836603.647601:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788836603.647782:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782899456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.647790:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788836603.647868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782899456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836603.716895:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836603.717080:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770241792 00000100:00100000:3.0:1788836603.717095:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770241792 00000100:00100000:3.0:1788836603.717182:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 156 00000100:00100000:3.0:1788836603.717195:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf47f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:12229:x1875730770241792:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836603.717247:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836603.717290:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa496 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717385:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717405:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717418:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717437:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717445:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717452:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717573:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717582:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717589:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836603.717640:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788836603.717651:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836603.717693:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717709:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717717:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717725:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717732:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836603.717737:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717746:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717761:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:3.0:1788836603.717765:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836603.717771:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717778:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717795:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717802:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717819:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717825:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836603.717828:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717835:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717844:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adf439d0200) 00010000:00010000:3.0:1788836603.717847:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836603.717850:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717856:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717894:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa496 expref: 15 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717910:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa496 expref: 14 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.717919:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:3.0:1788836603.717921:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788836603.717924:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700000, rc 0) 00000100:00100000:3.0:1788836603.718085:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf47f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:12229:x1875730770241792:12345-192.168.201.38@tcp:101:bash.0 Request processed in 892us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836603.718103:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 156 00000100:00100000:1.0:1788836603.721992:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836603.722067:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242048 00000100:00100000:3.0:1788836603.722081:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242048 00000100:00100000:2.0:1788836603.722191:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 157 00000100:00100000:2.0:1788836603.722207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+14:12229:x1875730770242048:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836603.722237:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836603.722276:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554a22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa49d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.722426:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.722470:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.722484:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.724972:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.725002:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.725031:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836603.726120:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788836603.726296:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726309:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726317:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726351:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726357:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726364:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726522:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836603.726526:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726533:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726546:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836603.726549:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836603.726553:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726559:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554a29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836603.726574:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065d4e4d8 reply state 000000000dd7bf44 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726584:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726590:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:2.0:1788836603.726592:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836603.726595:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788836603.726632:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554a22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726648:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.726668:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:2.0:1788836603.726671:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836603.726673:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031400, rc 0) 00000100:00100000:2.0:1788836603.726757:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:12229:x1875730770242048:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4553us (4790us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788836603.726766:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 157 00000100:00100000:1.0:1788836603.739575:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836603.739690:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242176 00000100:00100000:2.0:1788836603.739706:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242176 00000100:00100000:2.0:1788836603.739877:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788836603.739889:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770242176:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836603.739909:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836603.739931:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4a4 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836603.739960:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836603.739985:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788836603.739991:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836603.740000:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.740073:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.740089:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:2.0:1788836603.740157:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770242176:12345-192.168.201.38@tcp:101:bash.0 Request processed in 270us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.740176:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00080000:0.0:1788836603.740725:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836603.743220:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836603.743429:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242304 00000100:00100000:2.0:1788836603.743442:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242304 00000100:00100000:2.0:1788836603.743524:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:2.0:1788836603.743537:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:12229:x1875730770242304:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836603.743560:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836603.743585:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4ab expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.743640:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.743651:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836603.743657:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836603.743663:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.743721:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.743736:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 7 pid: 8405 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836603.743754:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf817bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782899584:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836603.743884:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836603.753320:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836603.753445:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242432 00000100:00100000:0.0:1788836603.753457:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242432 00010000:00010000:0.0:1788836603.753510:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 8 pid: 8405 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836603.753552:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:0.0:1788836603.753562:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770242432:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836603.753581:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836603.753608:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 8 pid: 8405 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.753622:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 8 pid: 8405 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.753657:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836603.753663:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836603.753675:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.753697:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.753745:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836603.753763:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6476:1875730782899712:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788836603.753884:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00010000:00010000:2.0:1788836603.754552:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037c4c5df/0xf7b38383a6554a45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4a4 expref: 8 pid: 8405 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836603.754576:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf817bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8407:1875730782899584:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836603.754604:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.754615:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836603.754656:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:12229:x1875730770242304:12345-192.168.201.38@tcp:101:bash.0 Request processed in 11124us (11452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836603.754663:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:1.0:1788836603.758763:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836603.759076:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6476:1875730782899712:192.168.201.38@tcp:105: 00010000:00010000:3.0:1788836603.759115:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836603.759195:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2394:x1875730770242432:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 5632us (5889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836603.759208:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:0.0:1788836603.761995:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242688 00000100:00100000:0.0:1788836603.762074:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242688 00000100:00100000:0.0:1788836603.762218:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1788836603.762231:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+17:12229:x1875730770242688:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:0.0:1788836603.762700:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:12229:x1875730770242688:12345-192.168.201.38@tcp:35:bash.0 Request processed in 469us (3951us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788836603.762708:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:1.0:1788836603.876149:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836603.876665:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770242944 00000100:00100000:2.0:1788836603.876686:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770242944 00000100:00100000:2.0:1788836603.876763:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:2.0:1788836603.876777:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:12239:x1875730770242944:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836603.876813:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836603.876841:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4b2 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836603.876988:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788836603.877167:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554a53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4b2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.877186:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:2.0:1788836603.877189:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836603.877195:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4b2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.877240:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:2.0:1788836603.877345:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12239:x1875730770242944:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 571us (1214us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788836603.877354:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:2.0:1788836603.881708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836603.881824:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770243200 00000100:00100000:1.0:1788836603.881838:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770243200 00000100:00100000:1.0:1788836603.881924:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:1.0:1788836603.881955:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12239:x1875730770243200:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836603.882329:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:12239:x1875730770243200:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 375us (645us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788836603.882339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:3.0:1788836603.966947:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836603.967057:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770243328 00000100:00100000:1.0:1788836603.967072:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770243328 00000100:00100000:1.0:1788836603.967149:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:1.0:1788836603.967161:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:12245:x1875730770243328:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836603.967193:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836603.967223:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4b9 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967325:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967344:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967357:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836603.967417:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788836603.967422:0:10333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836603.967447:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967478:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4b9 expref: 22 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967527:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4b9 expref: 21 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836603.967538:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836603.967541:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836603.967546:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb200, rc 0) 00000100:00100000:1.0:1788836603.967636:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12245:x1875730770243328:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 476us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836603.967644:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:2.0:1788836603.979405:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836603.979552:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770243584 00000100:00100000:3.0:1788836603.979567:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770243584 00000100:00100000:3.0:1788836603.979643:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:3.0:1788836603.979656:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12245:x1875730770243584:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836603.979685:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836603.979716:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554a6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4c0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.979866:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.979885:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.979899:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836603.979910:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788836603.980069:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554a6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c0 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.980104:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836603.980111:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:3.0:1788836603.980114:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836603.980117:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701a00, rc 0) 00000100:00100000:3.0:1788836603.980203:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:12245:x1875730770243584:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 548us (813us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788836603.980210:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:2.0:1788836603.983913:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836603.984067:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770243968 00000100:00100000:0.0:1788836603.984081:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770243968 00000100:00100000:0.0:1788836603.984166:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788836603.984180:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2397:x1875730770243968:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836603.984205:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836603.984240:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c0 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836603.984273:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:0.0:1788836603.984280:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836603.984357:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2397:x1875730770243968:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 179us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836603.984366:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788836603.991177:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836603.991370:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770243840 00000100:00100000:2.0:1788836603.991385:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770243840 00000100:00100000:2.0:1788836603.991641:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00100000:2.0:1788836603.991654:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:12245:x1875730770243840:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836603.991689:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836603.991717:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554a84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4c7 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.991874:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.991894:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.991908:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836603.991922:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788836603.992094:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554a84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c7 expref: 25 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.992143:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c7 expref: 24 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836603.992292:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:2.0:1788836603.992295:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836603.992300:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836603.992387:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12245:x1875730770243840:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 735us (1223us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788836603.992395:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00100000:2.0:1788836604.002941:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836604.003133:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244096 00000100:00100000:0.0:1788836604.003147:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244096 00000100:00100000:0.0:1788836604.003351:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788836604.003364:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770244096:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:0.0:1788836604.003426:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.003478:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.003489:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836604.003494:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836604.003499:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.003557:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 6 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.003574:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 6 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836604.003593:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782899840:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836604.003740:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836604.008713:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836604.009110:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244224 00000100:00100000:1.0:1788836604.009125:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244224 00002000:00100000:1.0:1788836604.009200:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8adf7fca8380 x1875730770244224/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:15/0 lens 504/0 e 0 to 0 dl 1788836615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836604.009215:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8adf7fca8380 with x1875730770244224 ext(0->12) 00010000:00010000:1.0:1788836604.009227:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 7 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.009248:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 7 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836604.009268:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8adf7fca8380 00000100:00100000:1.0:1788836604.009308:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1788836604.009320:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770244224:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:1.0:1788836604.011067:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2394:x1875730770244224:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 1734us (2355us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788836604.011100:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:1.0:1788836604.011115:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8adf7fca8380 x1875730770244224/t4294967306(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:15/0 lens 504/448 e 0 to 0 dl 1788836615 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836604.011125:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8adf7fca8380 with x1875730770244224 ext(0->12) 00010000:00010000:1.0:1788836604.011137:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.011157:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836604.011166:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8adf7fca8380 00000100:00100000:2.0:1788836604.014907:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782899840:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836604.014952:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836604.016622:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.016900:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244352 00000100:00100000:2.0:1788836604.016913:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244352 00010000:00010000:2.0:1788836604.016969:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836604.017106:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:2.0:1788836604.017118:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2396:x1875730770244352:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836604.017138:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788836604.017162:0:6474:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788836604.017165:0:6474:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788836603 00002000:00010000:2.0:1788836604.017185:0:6474:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788836603 00002000:00010000:2.0:1788836604.017188:0:6474:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788836603 00002000:00010000:2.0:1788836604.017190:0:6474:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788836604.017199:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.017216:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.017246:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7c7e691/0xf7b38383a6554a4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ab expref: 9 pid: 8407 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.017278:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836604.017283:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836604.017290:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.017301:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.017333:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836604.017409:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2396:x1875730770244352:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 293us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836604.017418:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00010000:00010000:0.0:1788836604.017577:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017589:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017614:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017649:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017658:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017666:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836604.017671:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017695:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017710:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.017718:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004218c902/0xf7b38383a6554a99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836604.017776:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770244096:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 14413us (14850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836604.017785:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788836604.021828:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836604.021972:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244608 00000100:00100000:1.0:1788836604.021986:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244608 00000100:00100000:1.0:1788836604.022249:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:1.0:1788836604.022291:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12245:x1875730770244608:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1788836604.022388:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c7 expref: 24 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836604.022829:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788836604.022868:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788836604.023388:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788836604.024572:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.024605:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 28 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.024868:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.024932:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 28 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.024951:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 28 pid: 6492 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836604.024967:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782899968:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836604.025196:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46111d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836604.034917:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.035073:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782899968:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836604.035111:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836604.035373:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244736 00000100:00100000:3.0:1788836604.035383:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244736 00010000:00010000:3.0:1788836604.035445:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 29 pid: 6492 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836604.035493:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:3.0:1788836604.035504:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:2394:x1875730770244736:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836604.035526:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836604.035535:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 29 pid: 6492 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035550:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 29 pid: 6492 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035578:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa49d expref: 29 pid: 6492 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035619:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:3.0:1788836604.035626:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035637:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035647:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.035671:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836604.035757:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:2394:x1875730770244736:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 254us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836604.035765:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00010000:00010000:1.0:1788836604.036314:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.036328:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836604.036496:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788836604.036805:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788836604.036926:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782900096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788836604.037001:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836604.037160:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b2f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836604.038324:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782900096 00000100:00100000:0.0:1788836604.038341:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782900096 00000100:00100000:0.0:1788836604.038410:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788836604.038450:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875730782900096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788836604.038814:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782900096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788836604.039038:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788836604.039142:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782900224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788836604.039192:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836604.039230:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836604.039235:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782900224 00000100:00100000:2.0:1788836604.039241:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782900224 00000100:00100000:2.0:1788836604.039297:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788836604.039306:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6493:x1875730782900224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788836604.039410:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6493:x1875730782900096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 963us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836604.039419:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788836604.039469:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6493:x1875730782900224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (276us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788836604.039477:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788836604.039499:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782900224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788836604.039546:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788836604.039585:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039596:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039615:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039622:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836604.039627:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039789:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039811:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:0.0:1788836604.039814:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788836604.039821:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.039828:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554aa0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836604.039952:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788836604.040180:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788836604.040197:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387946184592ns, next at 388946181167ns, rc = 0 00000001:00080000:0.0:1788836604.040204:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788836604.040236:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ade4273b100) 00010000:00010000:0.0:1788836604.040240:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788836604.040248:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554a8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4c7 expref: 32 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836604.040392:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+31:12245:x1875730770244608:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 18105us (18581us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788836604.040403:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000020:00080000:0.0:1788836604.040408:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788836604.043846:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836604.043933:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770244864 00000100:00100000:3.0:1788836604.043947:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770244864 00000100:00100000:3.0:1788836604.044077:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:3.0:1788836604.044090:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+31:12245:x1875730770244864:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836604.044127:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836604.044161:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554aa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4ce expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.044815:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ce expref: 32 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.044837:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ce expref: 32 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.044863:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836604.044867:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836604.044872:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701e00, rc 0) 00000100:00100000:3.0:1788836604.044958:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:12245:x1875730770244864:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 869us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836604.044968:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:3.0:1788836604.058896:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836604.059995:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770245120 00000100:00100000:0.0:1788836604.060047:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770245120 00000100:00100000:0.0:1788836604.060138:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:0.0:1788836604.060161:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:12245:x1875730770245120:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836604.060948:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:12245:x1875730770245120:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 794us (2065us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788836604.060959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:0.0:1788836604.233183:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.233390:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770245376 00000100:00100000:2.0:1788836604.233404:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770245376 00000100:00100000:2.0:1788836604.233507:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:2.0:1788836604.233521:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+33:12255:x1875730770245376:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836604.233559:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836604.233590:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4d5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836604.233730:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788836604.233873:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554aae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4d5 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.233891:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:2.0:1788836604.233895:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836604.233901:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4d5 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.233918:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836604.234070:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:12255:x1875730770245376:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 494us (855us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788836604.234098:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:1.0:1788836604.242334:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.242559:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770245504 00000100:00100000:2.0:1788836604.242571:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770245504 00000100:00100000:2.0:1788836604.242639:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:2.0:1788836604.242650:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:12255:x1875730770245504:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:2.0:1788836604.242740:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242759:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242773:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242784:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242791:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242798:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242872:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242881:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242887:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836604.242947:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242959:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242965:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242972:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242978:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836604.242982:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.242990:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243003:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836604.243006:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836604.243043:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243050:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554abc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243063:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243069:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243081:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243086:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836604.243089:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243096:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243103:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:2.0:1788836604.243106:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836604.243109:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243115:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554ac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243124:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243130:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243136:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243152:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836604.243154:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243169:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243178:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836604.243180:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836604.243183:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.243189:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554aca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836604.243280:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:12255:x1875730770245504:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 632us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836604.243288:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:1.0:1788836604.251320:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836604.251768:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770245760 00000100:00100000:0.0:1788836604.251779:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770245760 00000100:00100000:0.0:1788836604.251843:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:0.0:1788836604.251855:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:12255:x1875730770245760:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836604.252133:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:12255:x1875730770245760:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 278us (820us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788836604.252141:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00010000:00010000:1.0:1788836604.290184:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836604.304904:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836604.305461:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770246016 00000100:00100000:1.0:1788836604.305471:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770246016 00000100:00100000:1.0:1788836604.305522:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:1.0:1788836604.305528:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:12258:x1875730770246016:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836604.305549:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836604.305566:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4dc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305627:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305637:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305645:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305652:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305666:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305750:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305846:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305852:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305873:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836604.305882:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836604.305950:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305955:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305960:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305965:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836604.305971:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305978:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.305990:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836604.305993:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836604.305998:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306004:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554ad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306053:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306059:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306071:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306076:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836604.306079:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306084:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306091:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:1.0:1788836604.306094:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836604.306096:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306101:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554adf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306295:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306312:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 37 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.306319:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836604.306322:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836604.306324:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836604.306409:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12258:x1875730770246016:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 880us (1513us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788836604.306427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:1.0:1788836604.310695:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.310773:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770246144 00000100:00100000:2.0:1788836604.310783:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770246144 00000100:00100000:2.0:1788836604.310886:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:2.0:1788836604.310897:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12258:x1875730770246144:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1788836604.310968:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.310986:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.310997:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311065:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311090:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311097:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311104:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836604.311108:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311116:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311128:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836604.311131:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836604.311136:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.311143:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554af4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836604.311224:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12258:x1875730770246144:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 329us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836604.311233:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:1.0:1788836604.313990:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836604.314081:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770246400 00000100:00100000:3.0:1788836604.314091:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770246400 00000100:00100000:3.0:1788836604.314157:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:3.0:1788836604.314168:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12258:x1875730770246400:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836604.314937:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:12258:x1875730770246400:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 770us (957us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788836604.314944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1788836604.615479:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836604.615585:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770246656 00000100:00100000:2.0:1788836604.615597:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770246656 00000100:00100000:2.0:1788836604.615670:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:2.0:1788836604.615871:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:12289:x1875730770246656:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788836604.615898:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836604.615932:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554afb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4e3 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.616079:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554b02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.616094:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.616105:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836604.616116:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788836604.616300:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554afb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4e3 expref: 41 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.616320:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554b02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4e3 expref: 40 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836604.616329:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836604.616333:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836604.616336:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030800, rc 0) 00000100:00100000:2.0:1788836604.616436:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12289:x1875730770246656:12345-192.168.201.38@tcp:101:cat.0 Request processed in 570us (967us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788836604.616445:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:1.0:1788836604.621407:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836604.621826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836604.621901:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247040 00000100:00100000:0.0:1788836604.621911:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247040 00000100:00100000:0.0:1788836604.621976:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788836604.621986:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:2395:x1875730770247040:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836604.622002:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836604.622045:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554b02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4e3 expref: 40 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836604.622065:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:0.0:1788836604.622071:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836604.622128:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:2395:x1875730770247040:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 143us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836604.622238:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788836604.623680:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770246912 00000100:00100000:3.0:1788836604.623691:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770246912 00000100:00100000:3.0:1788836604.623770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788836604.623780:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:12289:x1875730770246912:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:3.0:1788836604.624006:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12289:x1875730770246912:12345-192.168.201.38@tcp:35:cat.0 Request processed in 226us (2606us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788836604.624045:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:1.0:1788836604.691569:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836604.691805:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247296 00000100:00100000:3.0:1788836604.691815:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247296 00000100:00100000:3.0:1788836604.691880:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:3.0:1788836604.691890:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12295:x1875730770247296:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836604.691915:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836604.691918:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788836604.691944:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4b9 expref: 40 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.691964:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:3.0:1788836604.691969:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836604.691984:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554b10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4ea expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.692140:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.692154:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.692161:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.692193:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.692206:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 40 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836604.692233:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4455bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782900352:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836604.692345:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836604.695301:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4455bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782900352:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836604.695330:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836604.696715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836604.697419:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247424 00000100:00100000:3.0:1788836604.697800:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247424 00010000:00010000:3.0:1788836604.697842:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 41 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836604.697934:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:3.0:1788836604.697945:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:2394:x1875730770247424:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836604.697962:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836604.697969:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 41 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.697980:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 41 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.698000:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4dc expref: 41 pid: 6490 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.698030:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836604.698036:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.698064:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.698073:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.698104:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836604.698173:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:2394:x1875730770247424:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 228us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836604.698181:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00010000:00010000:1.0:1788836604.699032:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.699044:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836604.699064:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836604.699212:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554b10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 41 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.699230:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 40 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.699238:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836604.699253:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836604.699256:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700a00, rc 0) 00000100:00100000:1.0:1788836604.699310:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12295:x1875730770247296:12345-192.168.201.38@tcp:101:dd.0 Request processed in 7421us (7750us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788836604.699317:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:1.0:1788836604.705302:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836604.705410:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247552 00000100:00100000:3.0:1788836604.705575:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247552 00000100:00100000:3.0:1788836604.705687:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:3.0:1788836604.705698:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12295:x1875730770247552:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836604.705723:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836604.705746:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554b25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705781:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705796:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705807:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705924:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 42 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705954:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 41 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836604.705962:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836604.705965:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836604.705968:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701800, rc 0) 00000100:00100000:3.0:1788836604.706278:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:12295:x1875730770247552:12345-192.168.201.38@tcp:101:dd.0 Request processed in 580us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836604.706285:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:0.0:1788836604.709382:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836604.709800:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247808 00000100:00100000:1.0:1788836604.709810:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247808 00000100:00100000:1.0:1788836604.709908:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:1.0:1788836604.709920:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:12295:x1875730770247808:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:1.0:1788836604.710182:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.710201:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.710212:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836604.710265:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788836604.710294:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000849384e6 reply state 0000000088196efe transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.710306:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836604.710313:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836604.710315:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836604.710318:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836604.710411:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:12295:x1875730770247808:12345-192.168.201.38@tcp:36:dd.0 Request processed in 494us (1038us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788836604.710419:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00000020:00080000:1.0:1788836604.710552:0:10681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788836605.090154:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.090313:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770247936 00000100:00100000:1.0:1788836605.090324:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770247936 00000100:00100000:1.0:1788836605.090402:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:1.0:1788836605.090436:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:12309:x1875730770247936:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:1.0:1788836605.090462:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836605.090484:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4f8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090548:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090562:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090571:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090584:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090590:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090595:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090666:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090677:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 45 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090685:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090728:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 45 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.090742:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 45 pid: 10333 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.090757:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782900480:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836605.090860:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e03c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788836605.090928:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836605.097680:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.097785:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770248192 00000100:00100000:2.0:1788836605.097795:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770248192 00000100:00100000:2.0:1788836605.097855:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788836605.097866:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:6169:x1875730770248192:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836605.097938:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782900480:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836605.097973:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836605.098603:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:6169:x1875730770248192:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 738us (940us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788836605.098611:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1788836605.107999:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.108139:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770248320 00000100:00100000:2.0:1788836605.108149:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770248320 00010000:00010000:2.0:1788836605.108190:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 47 pid: 10333 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836605.108242:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:2.0:1788836605.108252:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:2395:x1875730770248320:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836605.108267:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836605.108273:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 47 pid: 10333 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108286:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 47 pid: 10333 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108310:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554b17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ea expref: 47 pid: 10333 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108325:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.108340:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108349:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108356:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.108398:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836605.108457:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:2395:x1875730770248320:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 206us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.108464:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00010000:00010000:1.0:1788836605.109495:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109507:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836605.109559:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788836605.109563:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836605.109588:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109601:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109612:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109632:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109638:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109655:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836605.109666:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109674:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109686:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836605.109689:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836605.109694:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109702:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109717:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109724:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109731:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109737:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836605.109893:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109900:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109909:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:1.0:1788836605.109912:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836605.109915:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109921:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109958:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f8 expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109971:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f8 expref: 45 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.109978:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.109981:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836605.109983:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb200, rc 0) 00000100:00100000:1.0:1788836605.110073:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:12309:x1875730770247936:12345-192.168.201.38@tcp:101:stat.0 Request processed in 19647us (19929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836605.110082:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:0.0:1788836605.174790:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.174881:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770248576 00000100:00100000:1.0:1788836605.174891:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770248576 00000100:00100000:1.0:1788836605.174946:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:1.0:1788836605.174957:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:12315:x1875730770248576:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:1.0:1788836605.175054:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836605.175081:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f8 expref: 45 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.175100:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.175104:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836605.175301:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.175315:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.175324:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836605.175374:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788836605.175393:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028f1c717 reply state 000000004d12036d transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.175404:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.175410:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.175412:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836605.175415:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836605.175741:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:12315:x1875730770248576:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 782us (957us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788836605.175750:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000020:00080000:1.0:1788836605.175755:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836605.310591:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836605.380431:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.381806:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770248704 00000100:00100000:2.0:1788836605.381822:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770248704 00000100:00100000:2.0:1788836605.381954:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:2.0:1788836605.381978:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:12329:x1875730770248704:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:2.0:1788836605.382004:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836605.382043:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554b5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa4ff expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382111:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382137:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382148:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382160:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382167:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382174:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382280:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382289:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382297:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836605.382350:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788836605.382355:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836605.382375:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382387:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382395:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382401:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382407:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382413:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836605.382417:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382668:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382688:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836605.382691:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836605.382696:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382703:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554b64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382717:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382723:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382729:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382735:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836605.382738:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382744:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382752:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:2.0:1788836605.382754:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836605.382757:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382763:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554b6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382802:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554b5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 49 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382816:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 48 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.382824:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.382826:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836605.382829:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836605.382905:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+48:12329:x1875730770248704:12345-192.168.201.38@tcp:101:stat.0 Request processed in 940us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.382913:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:3.0:1788836605.521004:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.521146:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770248960 00000100:00100000:1.0:1788836605.521169:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770248960 00000100:00100000:1.0:1788836605.521287:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:1.0:1788836605.521298:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+48:12339:x1875730770248960:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836605.521328:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836605.521347:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa506 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836605.521454:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788836605.521549:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa506 expref: 50 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.521563:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:1.0:1788836605.521566:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836605.521571:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa506 expref: 50 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.521586:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb200, rc 0) 00000100:00100000:1.0:1788836605.521662:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:12339:x1875730770248960:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 365us (668us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788836605.521669:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:3.0:1788836605.524663:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.524771:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770249216 00000100:00100000:2.0:1788836605.524781:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770249216 00000100:00100000:2.0:1788836605.524837:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:2.0:1788836605.524847:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+49:12339:x1875730770249216:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788836605.525093:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:12339:x1875730770249216:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 246us (456us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788836605.525102:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788836605.600250:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.600361:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770249472 00000100:00100000:1.0:1788836605.600372:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770249472 00000100:00100000:1.0:1788836605.600445:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:1.0:1788836605.600456:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+50:12345:x1875730770249472:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836605.600482:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836605.600503:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa50d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.600633:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.600875:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 51 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.600887:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.600922:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 51 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.600935:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 51 pid: 12185 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.600948:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782900608:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836605.601101:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836605.605156:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.605324:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770249600 00000100:00100000:2.0:1788836605.605334:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770249600 00010000:00010000:2.0:1788836605.605373:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 52 pid: 12185 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836605.605414:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:2.0:1788836605.605432:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:2394:x1875730770249600:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836605.605462:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836605.605468:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 52 pid: 12185 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.605482:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 52 pid: 12185 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.605505:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.605510:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.605520:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.605527:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.605546:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836605.605608:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:2394:x1875730770249600:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 185us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.605615:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00010000:00010000:1.0:1788836605.606294:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ff expref: 51 pid: 12185 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.606312:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782900608:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836605.606332:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.606342:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.606361:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836605.606379:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788836605.606522:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554b87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.606540:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 51 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.606547:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.606550:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836605.606553:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836605.606599:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4455aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:12345:x1875730770249472:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6145us (6360us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788836605.606607:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:3.0:1788836605.609796:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.609921:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770249856 00000100:00100000:1.0:1788836605.609932:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770249856 00000100:00100000:1.0:1788836605.609989:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:1.0:1788836605.609999:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+51:12345:x1875730770249856:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1788836605.610265:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.610285:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.610295:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836605.610352:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1788836605.610375:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000672c1e10 reply state 00000000f0d248df transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.610387:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.610395:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.610398:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836605.610402:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836605.610504:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12345:x1875730770249856:12345-192.168.201.38@tcp:36:bash.0 Request processed in 507us (716us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788836605.610511:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 176 00000020:00080000:1.0:1788836605.610515:0:10681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788836605.615848:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.615950:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770249984 00000100:00100000:1.0:1788836605.615961:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770249984 00000100:00100000:1.0:1788836605.616053:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:1.0:1788836605.616063:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12345:x1875730770249984:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836605.616089:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836605.616114:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554ba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa514 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.616221:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.616248:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.616277:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.616313:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.616327:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 55 pid: 6491 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.616353:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782900736:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836605.616432:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf467e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836605.620469:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.620589:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770250112 00000100:00100000:2.0:1788836605.620599:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770250112 00010000:00010000:2.0:1788836605.620655:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 56 pid: 6491 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836605.620695:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1788836605.620705:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:2394:x1875730770250112:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836605.620737:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836605.620745:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 56 pid: 6491 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.620758:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 56 pid: 6491 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.620781:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.620786:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.620797:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.620804:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.620821:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836605.620887:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:2394:x1875730770250112:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.620894:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00010000:00010000:1.0:1788836605.622195:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554b8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa50d expref: 55 pid: 6491 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.622217:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782900736:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836605.622246:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.622256:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.622263:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836605.622314:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788836605.622319:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836605.622339:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.622383:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554ba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa514 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.622398:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa514 expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.622406:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.622409:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836605.622412:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea200, rc 0) 00000100:00100000:1.0:1788836605.622546:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade437f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12345:x1875730770249984:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6483us (6709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836605.622554:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:0.0:1788836605.625851:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.625955:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770250368 00000100:00100000:2.0:1788836605.625965:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770250368 00000100:00100000:2.0:1788836605.626193:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1788836605.626204:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12345:x1875730770250368:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788836605.626836:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:12345:x1875730770250368:12345-192.168.201.38@tcp:35:bash.0 Request processed in 632us (992us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788836605.626845:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1788836605.694419:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf5071d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782900864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836605.694508:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836605.694682:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782900864 00000100:00100000:0.0:1788836605.694690:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782900864 00000100:00100000:0.0:1788836605.694745:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788836605.694755:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782900864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836605.694791:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836605.694850:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782900864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836605.694871:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788836605.695070:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf5071d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782900864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836605.752877:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.752977:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770250624 00000100:00100000:2.0:1788836605.752988:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770250624 00000100:00100000:2.0:1788836605.753081:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00100000:2.0:1788836605.753091:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:12355:x1875730770250624:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836605.753130:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836605.753151:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa51b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836605.753266:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788836605.753359:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa51b expref: 57 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.753372:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:2.0:1788836605.753374:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836605.753379:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa51b expref: 57 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.753391:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836605.753440:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12355:x1875730770250624:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 350us (574us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788836605.753448:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00100000:0.0:1788836605.757538:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836605.757638:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770250752 00000100:00100000:1.0:1788836605.757648:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770250752 00000100:00100000:1.0:1788836605.757712:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:1.0:1788836605.757723:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12355:x1875730770250752:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:1.0:1788836605.757801:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757818:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757830:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757857:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757865:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757872:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757943:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757953:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.757959:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836605.758007:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758057:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758064:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758070:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758076:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836605.758081:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758096:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758698:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836605.758704:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836605.758711:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758719:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554bbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758734:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758740:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758746:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758751:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836605.758754:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758760:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758769:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:1.0:1788836605.758771:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836605.758774:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758792:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758803:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758809:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758816:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758821:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836605.758824:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758830:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758837:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836605.758839:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836605.758842:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836605.758849:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554bcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836605.758939:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12355:x1875730770250752:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1215us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836605.758947:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:0.0:1788836605.765355:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836605.765443:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770251008 00000100:00100000:3.0:1788836605.765455:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770251008 00000100:00100000:3.0:1788836605.765518:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788836605.765529:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12355:x1875730770251008:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836605.765772:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:12355:x1875730770251008:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 244us (428us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788836605.765780:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:0.0:1788836605.807750:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836605.807875:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770251264 00000100:00100000:3.0:1788836605.807900:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770251264 00000100:00100000:3.0:1788836605.807963:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:3.0:1788836605.807973:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+57:12358:x1875730770251264:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836605.807997:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836605.808042:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa522 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808132:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808146:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808158:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808168:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808176:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808182:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808302:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554be9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808312:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808319:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836605.808335:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788836605.808433:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808441:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808448:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808453:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836605.808458:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808465:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808476:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:3.0:1788836605.808479:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836605.808483:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808489:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554bdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808501:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808507:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808524:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808529:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836605.808533:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808540:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808548:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:3.0:1788836605.808550:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836605.808552:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808558:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554be2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808593:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa522 expref: 60 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808605:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa522 expref: 59 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836605.808612:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836605.808614:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836605.808617:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700a00, rc 0) 00000100:00100000:3.0:1788836605.809314:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12358:x1875730770251264:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1337us (1569us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788836605.809333:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:0.0:1788836605.813436:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.813530:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770251392 00000100:00100000:2.0:1788836605.813540:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770251392 00000100:00100000:2.0:1788836605.813598:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:2.0:1788836605.813608:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12358:x1875730770251392:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1788836605.813678:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813711:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813722:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813758:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813766:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813772:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813777:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836605.813781:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813789:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813800:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.813803:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836605.813807:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.813813:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836605.813887:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12358:x1875730770251392:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 281us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.813900:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:0.0:1788836605.816857:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.816943:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770251520 00000100:00100000:2.0:1788836605.816954:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770251520 00000100:00100000:2.0:1788836605.817041:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1788836605.817052:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:2394:x1875730770251520:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836605.817071:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836605.817099:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554be9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa522 expref: 59 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.817128:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.817133:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836605.817193:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:2394:x1875730770251520:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 142us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836605.817200:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:0.0:1788836605.818856:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836605.818942:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770251776 00000100:00100000:3.0:1788836605.818954:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770251776 00000100:00100000:3.0:1788836605.819002:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788836605.819060:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:12358:x1875730770251776:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836605.819296:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12358:x1875730770251776:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 284us (448us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788836605.819305:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1788836605.980982:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836605.981550:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252032 00000100:00100000:2.0:1788836605.981559:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252032 00000100:00100000:2.0:1788836605.981623:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:2.0:1788836605.981633:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12376:x1875730770252032:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788836605.981667:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836605.981686:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa529 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.981785:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.981799:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.981825:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836605.981836:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788836605.981953:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554bfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa529 expref: 62 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.981971:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa529 expref: 61 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836605.981980:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836605.981983:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788836605.981987:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031600, rc 0) 00000100:00100000:3.0:1788836605.982447:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12376:x1875730770252032:12345-192.168.201.38@tcp:101:cat.0 Request processed in 813us (1476us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788836605.982455:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:0.0:1788836606.017760:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.017857:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252160 00000100:00100000:1.0:1788836606.017867:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252160 00000100:00100000:1.0:1788836606.017937:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:1.0:1788836606.017948:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12377:x1875730770252160:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836606.017974:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836606.017996:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa530 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018094:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018109:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018120:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836606.018163:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788836606.018167:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836606.018186:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018212:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa530 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018243:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa530 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.018250:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836606.018252:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836606.018271:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836606.018327:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12377:x1875730770252160:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 382us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.018332:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:0.0:1788836606.024617:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.024681:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252544 00000100:00100000:3.0:1788836606.024690:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252544 00000100:00100000:3.0:1788836606.024734:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1788836606.024741:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12377:x1875730770252544:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836606.025007:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12377:x1875730770252544:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 265us (399us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788836606.025037:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788836606.028725:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.028853:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252672 00000100:00100000:2.0:1788836606.028864:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252672 00000100:00100000:2.0:1788836606.029070:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836606.029081:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12377:x1875730770252672:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:2.0:1788836606.029101:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836606.029134:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554baa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa514 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.029158:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa529 expref: 62 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.029170:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554aa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4ce expref: 61 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.029199:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:2.0:1788836606.029203:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836606.029271:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12377:x1875730770252672:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 192us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.029278:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1788836606.032358:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.032679:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252800 00000100:00100000:2.0:1788836606.032689:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252800 00000100:00100000:2.0:1788836606.032805:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:2.0:1788836606.032817:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12377:x1875730770252800:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:2.0:1788836606.032949:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.032968:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.032981:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836606.033106:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788836606.033202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12377:x1875730770252800:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 385us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.033210:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:3.0:1788836606.047849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.047915:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770252928 00000100:00100000:1.0:1788836606.047926:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770252928 00000100:00100000:1.0:1788836606.047988:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:1.0:1788836606.047999:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12379:x1875730770252928:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836606.048044:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836606.048067:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554c28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa537 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048164:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048179:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048189:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048200:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048206:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048212:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048313:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048328:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048335:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836606.048373:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788836606.048377:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836606.048396:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048407:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048414:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048648:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048657:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048663:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836606.048668:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048675:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048690:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836606.048700:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836606.048706:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048712:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb200/0xf7b38383a6554c2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048727:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048733:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048740:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048746:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836606.048867:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048876:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048883:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:1.0:1788836606.048886:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836606.048889:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048894:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea200/0xf7b38383a6554c36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048925:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb400/0xf7b38383a6554c28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 62 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048950:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 61 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.048957:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836606.048959:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836606.048962:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6800, rc 0) 00000100:00100000:1.0:1788836606.049702:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12379:x1875730770252928:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1701us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.049711:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 185 00010000:00010000:1.0:1788836606.335947:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836606.336252:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836606.336257:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836606.336446:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788836606.336455:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836606.336591:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc27100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782900992:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836606.336703:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836606.350802:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.350834:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770253056 00000100:00100000:1.0:1788836606.350843:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770253056 00000100:00100000:1.0:1788836606.350911:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:1.0:1788836606.350921:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253056:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836606.350952:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836606.351089:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253056:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 169us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.351096:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:2.0:1788836606.351415:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc27100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782900992:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836606.359452:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.359586:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770253184 00000100:00100000:0.0:1788836606.359595:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770253184 00000100:00100000:0.0:1788836606.359680:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:0.0:1788836606.359690:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12390:x1875730770253184:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836606.359761:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359778:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359790:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359806:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359831:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359837:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359977:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359988:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.359996:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836606.360072:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788836606.360077:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836606.360089:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360100:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360106:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360113:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360118:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836606.360122:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360135:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360147:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:0.0:1788836606.360150:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836606.360155:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360161:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172e00/0xf7b38383a6554c44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360173:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360179:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360184:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360190:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82172c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836606.360193:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360199:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360206:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8adf4b4fbb00) 00010000:00010000:0.0:1788836606.360208:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836606.360220:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360236:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82172c00/0xf7b38383a6554c4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360251:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360257:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360263:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360268:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836606.360271:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360277:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360284:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:0.0:1788836606.360287:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836606.360290:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.360295:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.360360:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12390:x1875730770253184:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 672us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836606.360368:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:3.0:1788836606.375473:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.385195:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770253440 00000100:00100000:2.0:1788836606.385223:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770253440 00000100:00100000:3.0:1788836606.385568:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:3.0:1788836606.385579:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+61:12390:x1875730770253440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.385598:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836606.385618:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554c59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa53e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385721:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385737:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385748:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836606.385760:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788836606.385836:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385844:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385851:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385856:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.385860:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385867:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385899:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.385902:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836606.385906:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385912:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385949:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554c59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa53e expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385958:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:3.0:1788836606.385961:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836606.385964:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554c59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa53e expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.385974:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701c00, rc 0) 00000100:00100000:3.0:1788836606.386088:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 509us (10625us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788836606.386096:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:1.0:1788836606.392087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.392193:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770253568 00000100:00100000:2.0:1788836606.392205:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770253568 00000100:00100000:2.0:1788836606.392285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:2.0:1788836606.392295:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253568:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836606.392330:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836606.392446:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253568:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.392454:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:2.0:1788836606.399246:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.399328:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770253824 00000100:00100000:1.0:1788836606.399339:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770253824 00000100:00100000:1.0:1788836606.399398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:1.0:1788836606.399407:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770253824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836606.399429:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836606.399443:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836606.399470:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6554c1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa530 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.399489:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836606.399494:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836606.399508:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554c6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa545 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836606.399884:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788836606.400070:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554c75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.400086:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.400097:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.400151:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554c6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa545 expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.400168:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa545 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.400175:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ade438f2000) 00010000:00010000:1.0:1788836606.400178:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836606.400182:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7c00, rc 0) 00000100:00100000:1.0:1788836606.400254:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12390:x1875730770253824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 847us (1021us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788836606.400273:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:1.0:1788836606.406274:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.407604:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254080 00000100:00100000:2.0:1788836606.407620:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254080 00000100:00100000:2.0:1788836606.407704:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788836606.407715:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12390:x1875730770254080:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836606.407773:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836606.407800:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554c75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa545 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407820:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ade438f2000) 00010000:00010000:2.0:1788836606.407831:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836606.407853:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407879:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407889:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407939:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407962:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.407968:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408044:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408051:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408057:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408064:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836606.408069:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408076:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408085:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836606.408088:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836606.408092:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408098:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554c83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408120:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408132:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408138:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408144:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836606.408147:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408154:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408162:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8cc6d698 (ffff8ade4273b700) 00010000:00010000:2.0:1788836606.408165:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836606.408168:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.408174:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554c8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8cc6d698 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.408315:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770254080:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 600us (2051us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836606.408322:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788836606.415142:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.415392:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254208 00000100:00100000:3.0:1788836606.415402:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254208 00000100:00100000:3.0:1788836606.415463:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:3.0:1788836606.415474:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+62:12390:x1875730770254208:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.415496:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836606.415519:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554c91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa54c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415573:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415587:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415599:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415713:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554c91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415729:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.415738:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.415741:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836606.415745:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836606.415798:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12390:x1875730770254208:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 326us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.415805:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:3.0:1788836606.418224:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.420245:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254464 00000100:00100000:0.0:1788836606.420261:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254464 00000100:00100000:0.0:1788836606.420335:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:0.0:1788836606.420345:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12390:x1875730770254464:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836606.420429:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.420447:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.420459:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836606.420626:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788836606.420650:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390326637378ns, next at 391326621266ns, rc = 0 00000004:00010000:0.0:1788836606.420703:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe895205 reply state 0000000084b9b3b0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.420717:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.420725:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:0.0:1788836606.420728:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788836606.420732:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836606.420837:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12390:x1875730770254464:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 492us (2631us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788836606.420845:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:1.0:1788836606.435171:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.435434:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254592 00000100:00100000:3.0:1788836606.435447:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254592 00000100:00100000:3.0:1788836606.435508:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:3.0:1788836606.435518:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12390:x1875730770254592:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.435542:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836606.435593:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa553 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.435651:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 66 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.435667:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 66 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.435685:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.435689:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836606.435693:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701200, rc 0) 00000100:00100000:3.0:1788836606.435747:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12390:x1875730770254592:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 231us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.435754:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:1.0:1788836606.444526:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.444632:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254720 00000100:00100000:0.0:1788836606.444700:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254720 00000100:00100000:0.0:1788836606.446041:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1788836606.446056:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+6:2395:x1875730770254720:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788836606.446291:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770254720:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 238us (1776us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788836606.446299:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00080000:1.0:1788836606.447493:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836606.453097:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.455315:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770254976 00000100:00100000:3.0:1788836606.455331:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770254976 00000100:00100000:3.0:1788836606.457673:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788836606.457692:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12390:x1875730770254976:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836606.457925:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12390:x1875730770254976:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 238us (4836us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788836606.457934:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:1.0:1788836606.471820:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.471923:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770255232 00000100:00100000:2.0:1788836606.471932:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770255232 00000100:00100000:2.0:1788836606.471986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:2.0:1788836606.472002:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12390:x1875730770255232:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836606.472147:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12390:x1875730770255232:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.472155:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:1.0:1788836606.475627:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.475764:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770255360 00000100:00100000:3.0:1788836606.475774:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770255360 00000100:00100000:3.0:1788836606.475834:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:3.0:1788836606.475845:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12390:x1875730770255360:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.475866:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836606.475895:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554cad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa55a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.475964:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.475979:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.475990:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836606.476057:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836606.476079:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.476164:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701c00/0xf7b38383a6554cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa55a expref: 69 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.476183:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa55a expref: 68 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.476192:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.476195:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788836606.476198:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700c00, rc 0) 00000100:00100000:3.0:1788836606.476263:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12390:x1875730770255360:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 420us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.476271:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:1.0:1788836606.478522:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.478585:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770255488 00000100:00100000:3.0:1788836606.478595:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770255488 00000100:00100000:3.0:1788836606.478671:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788836606.478681:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770255488:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.478700:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836606.478720:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa561 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836606.478744:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7afe, blocks: 0x0 00010000:00010000:3.0:1788836606.478764:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788836606.478769:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836606.478778:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.478795:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.478809:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701a00, rc 0) 00000100:00100000:3.0:1788836606.478859:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770255488:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 179us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.478866:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1788836606.482482:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.482555:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770255744 00000100:00100000:0.0:1788836606.482565:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770255744 00000100:00100000:0.0:1788836606.482630:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:0.0:1788836606.482651:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12390:x1875730770255744:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788836606.482768:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12390:x1875730770255744:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836606.482775:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:1.0:1788836606.493266:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.493405:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770255872 00000100:00100000:0.0:1788836606.493416:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770255872 00000100:00100000:0.0:1788836606.493627:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1788836606.493747:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:12390:x1875730770255872:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836606.493768:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836606.493786:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa568 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.493815:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.493825:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836606.493829:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836606.493834:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 9 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.493877:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.493891:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 9 pid: 8408 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.493907:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1875730782901120:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836606.493998:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836606.498834:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.498867:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256000 00000100:00100000:2.0:1788836606.498876:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256000 00010000:00010000:2.0:1788836606.498916:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 10 pid: 8408 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.498953:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:2.0:1788836606.498963:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770256000:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836606.498979:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836606.498999:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 10 pid: 8408 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.499033:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 10 pid: 8408 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.499059:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836606.499063:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836606.499072:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 10 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.499082:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 10 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.499143:0:13174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 10 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.499158:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13174:1875730782901248:192.168.201.38@tcp:105: 00000100:00100000:2.0:1788836606.499238:0:13174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf72c9f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836606.501283:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13174:1875730782901248:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788836606.501306:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836606.501348:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770256000:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 2386us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.501358:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00010000:00010000:1.0:1788836606.506309:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a47c120/0xf7b38383a6554cbb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa561 expref: 9 pid: 8408 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836606.506335:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1875730782901120:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836606.506371:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.506389:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993000, rc 0) 00000100:00100000:1.0:1788836606.506463:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:12390:x1875730770255872:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 12825us (13208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.506471:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1788836606.511977:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.512133:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256128 00000100:00100000:3.0:1788836606.512144:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256128 00002000:00100000:3.0:1788836606.512192:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ade439fe680 x1875730770256128/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:17/0 lens 504/0 e 0 to 0 dl 1788836617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836606.512205:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439fe680 with x1875730770256128 ext(0->8) 00002000:00010000:3.0:1788836606.512219:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade439fe680 00000100:00100000:3.0:1788836606.512252:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788836606.512278:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770256128:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788836606.513234:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2394:x1875730770256128:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 953us (1261us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788836606.513244:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00002000:00100000:3.0:1788836606.513253:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ade439fe680 x1875730770256128/t4294967315(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:17/0 lens 504/448 e 0 to 0 dl 1788836617 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836606.513261:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade439fe680 with x1875730770256128 ext(0->8) 00002000:00010000:3.0:1788836606.513265:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade439fe680 00000100:00100000:3.0:1788836606.519153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.519284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256256 00000100:00100000:0.0:1788836606.519293:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256256 00000100:00100000:0.0:1788836606.519350:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:0.0:1788836606.519361:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12390:x1875730770256256:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788836606.521825:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788836606.521843:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788836606.521892:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788836606.521906:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ade428ccb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788836606.521911:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf7873cb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ade428ccc00 00000020:00080000:3.0:1788836606.521914:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf7873c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade43934a00 00010000:00010000:3.0:1788836606.521956:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.521967:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.521974:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.521980:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.521985:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522000:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522038:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273bf00) 00010000:00010000:3.0:1788836606.522042:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836606.522047:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522053:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554a30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522076:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522083:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522088:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522093:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eba00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.522096:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522114:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522123:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.522125:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836606.522128:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522144:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6554b33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522157:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522163:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522169:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522174:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.522177:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522183:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522191:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.522193:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836606.522195:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522200:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6554b56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522219:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522225:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522237:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522243:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.522250:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522257:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522265:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.522267:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836606.522269:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522275:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eaa00/0xf7b38383a6554b9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522287:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522292:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522297:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522302:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.522304:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522318:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522327:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.522330:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836606.522333:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.522338:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554c9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836606.522554:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836606.522574:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782901376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836606.522576:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12390:x1875730770256256:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 3214us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.522584:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:3.0:1788836606.522619:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782901504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788836606.522625:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836606.522658:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836606.522672:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782901376 00000100:00100000:1.0:1788836606.522679:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782901376 00000100:00100000:1.0:1788836606.522717:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782901504 00000100:00100000:1.0:1788836606.522721:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782901504 00000100:00100000:1.0:1788836606.522740:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836606.522747:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782901376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788836606.523683:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788836606.523689:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788836606 00002000:00010000:1.0:1788836606.523692:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788836606.523694:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788836606 -> 1788836606 00002000:00010000:1.0:1788836606.523696:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788836606.523746:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782901376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 998us (1118us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788836606.523755:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836606.523775:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836606.523783:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782901504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788836606.523803:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00000020:00080000:2.0:1788836606.524418:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788836606.524471:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788836606.524908:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00002000:00010000:1.0:1788836606.524937:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7afb, atime: 0x6a9f7afb, ctime: 0x6a9f7afb, blocks: 0x8 00010000:00010000:1.0:1788836606.524947:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.524965:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788836606.524970:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836606.524977:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525001:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525045:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525053:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525069:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788836606.525416:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1875730782901504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1632us (2756us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788836606.525425:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836606.525449:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256384 00000100:00100000:1.0:1788836606.525459:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256384 00000100:00100000:1.0:1788836606.525488:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788836606.525496:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770256384:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788836606.525555:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836606.525561:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525570:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836606.525574:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525597:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525613:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.525620:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4015bb5/0xf7b38383a6554cc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836606.525626:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adf7fc9b480/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788836606.525632:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782901504:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788836606.525637:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836606.525639:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836606.525641:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788836606.526176:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adf7fc9a680/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788836606.526184:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782901376:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788836606.526220:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836606.526226:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788836606.527894:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788836606.527907:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788836606.528317:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770256384:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 2816us (3407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.528330:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1788836606.532288:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.532455:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256640 00000100:00100000:2.0:1788836606.532464:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256640 00000100:00100000:2.0:1788836606.532513:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:2.0:1788836606.532520:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12390:x1875730770256640:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836606.532565:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836606.532586:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa55a expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.532599:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:2.0:1788836606.532603:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836606.532626:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.532684:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.532697:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836606.532806:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000560df010 reply state 00000000c1b6b322 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.532816:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.532821:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:2.0:1788836606.532823:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836606.532826:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836606.532928:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:12390:x1875730770256640:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 407us (651us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788836606.532936:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:2.0:1788836606.540566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.540859:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770256768 00000100:00100000:0.0:1788836606.540869:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770256768 00000100:00100000:0.0:1788836606.540971:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1788836606.540983:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770256768:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788836606.541167:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788836606.541171:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788836606 -> 1788836605 00002000:00010000:0.0:1788836606.541174:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788836603 00002000:00010000:0.0:1788836606.541176:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788836606 -> 1788836605 00002000:00010000:0.0:1788836606.541178:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788836606.541260:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770256768:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 279us (4257us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788836606.541272:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836606.543392:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.544493:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257024 00000100:00100000:0.0:1788836606.544506:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257024 00000100:00100000:0.0:1788836606.544595:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:0.0:1788836606.544606:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:12390:x1875730770257024:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788836606.544672:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.544690:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.544700:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.544735:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.544748:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 20 pid: 6490 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.544762:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782901632:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836606.544843:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836606.546886:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782901632:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836606.546915:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.547738:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836606.547861:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257152 00000100:00100000:0.0:1788836606.547883:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257152 00010000:00010000:0.0:1788836606.547922:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 21 pid: 6490 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.547969:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:0.0:1788836606.547979:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:2394:x1875730770257152:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836606.547993:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836606.548000:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 21 pid: 6490 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548030:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 21 pid: 6490 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548053:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa54c expref: 21 pid: 6490 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548070:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:0.0:1788836606.548075:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548099:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548106:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836606.548136:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836606.548184:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.548191:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:2394:x1875730770257152:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 213us (458us total) trans 0 rc 0/0 00010000:00010000:3.0:1788836606.548203:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.548205:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00010000:00010000:3.0:1788836606.548253:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548260:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548266:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548271:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.548276:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548283:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548293:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.548296:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788836606.548300:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.548305:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554cd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.548369:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12390:x1875730770257024:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 3765us (4985us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788836606.548377:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:2.0:1788836606.554223:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.554502:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257280 00000100:00100000:3.0:1788836606.554513:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257280 00000100:00100000:3.0:1788836606.554565:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788836606.554575:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770257280:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.554618:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.555427:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.555440:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836606.555445:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836606.555450:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.555488:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.555504:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 8 pid: 8498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.555519:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1875730782901760:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836606.555598:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836606.564161:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1875730782901760:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836606.564192:0:8498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836606.565034:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.565811:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257408 00000100:00100000:2.0:1788836606.565823:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257408 00010000:00010000:2.0:1788836606.565863:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 9 pid: 8498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.565909:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:2.0:1788836606.565920:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2394:x1875730770257408:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836606.565935:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836606.565955:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 9 pid: 8498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.565981:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 9 pid: 8498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.566003:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554cc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa568 expref: 9 pid: 8498 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.566043:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836606.566048:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836606.566054:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.566063:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.566908:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836606.566926:0:8498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.566938:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.566964:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.566980:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.566984:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770257408:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1064us (1975us total) trans 0 rc 0/0 00010000:00010000:1.0:1788836606.566989:0:8498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.566994:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00010000:00010000:1.0:1788836606.566997:0:8498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836606.567001:0:8498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.568415:0:8498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.568520:0:8498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.568529:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf31612/0xf7b38383a6554cde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836606.568648:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770257280:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 14071us (14441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.568658:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1788836606.572642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.572692:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257664 00000100:00100000:3.0:1788836606.572702:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257664 00000100:00100000:3.0:1788836606.572758:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:3.0:1788836606.572769:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12390:x1875730770257664:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836606.572855:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.572874:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.572884:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.572918:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.572932:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 19 pid: 6491 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.572948:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782901888:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836606.573067:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836606.575854:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782901888:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836606.575885:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.578392:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836606.578522:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257792 00000100:00100000:3.0:1788836606.578532:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257792 00010000:00010000:3.0:1788836606.578570:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 20 pid: 6491 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.578604:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:3.0:1788836606.578612:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:2394:x1875730770257792:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836606.578627:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836606.578639:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 20 pid: 6491 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578667:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 20 pid: 6491 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578689:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa4f1 expref: 20 pid: 6491 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578704:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.578709:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578718:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578725:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.578754:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836606.578799:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:2394:x1875730770257792:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 187us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.578806:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00010000:00010000:2.0:1788836606.578916:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.578925:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.579123:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.579140:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 19 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.579148:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.579174:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 19 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.579187:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 19 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836606.579200:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc21500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902016:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836606.579258:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf442f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836606.582432:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.582524:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc21500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902016:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836606.582553:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.582641:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770257920 00000100:00100000:3.0:1788836606.582648:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770257920 00010000:00010000:3.0:1788836606.582682:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 20 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.582751:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:3.0:1788836606.582762:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:2395:x1875730770257920:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836606.582791:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836606.582797:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 20 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582808:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 20 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582827:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ca6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa553 expref: 20 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582841:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.582846:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582855:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582862:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.582886:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836606.582931:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:2395:x1875730770257920:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 171us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.582939:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00010000:00010000:1.0:1788836606.582979:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.582986:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836606.583103:0:10333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788836606.583236:0:10333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788836606.583268:0:10333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788836606.583341:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10333:1875730782902144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788836606.583387:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836606.583413:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836606.583743:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782902144 00000100:00100000:3.0:1788836606.583749:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782902144 00000100:00100000:3.0:1788836606.583813:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788836606.583820:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10333:x1875730782902144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788836606.583927:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf5076f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10333:x1875730782902144:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836606.583940:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788836606.583983:0:10333:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788836606.583989:0:10333:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adf7fc9a680, transno 4294967316 00000100:00100000:2.0:1788836606.584000:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10333:1875730782902144:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788836606.584240:0:10333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788836606.584291:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fc20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10333:1875730782902272:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788836606.584323:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836606.584381:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836606.584424:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782902272 00000100:00100000:3.0:1788836606.584428:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782902272 00000100:00100000:3.0:1788836606.584458:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788836606.584465:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10333:x1875730782902272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788836606.584546:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10333:x1875730782902272:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (223us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788836606.584553:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788836606.584726:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fc20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10333:1875730782902272:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788836606.584807:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584816:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584823:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584829:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.584834:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584842:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584856:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.584859:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836606.584863:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584881:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554cec lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584905:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584910:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584916:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584921:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.584924:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584929:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584937:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.584939:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836606.584942:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584948:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554c21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584969:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584982:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.584996:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.585038:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.585052:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 22 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.585063:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902400:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836606.585277:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836606.588450:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.588522:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258048 00000100:00100000:1.0:1788836606.588532:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258048 00010000:00010000:1.0:1788836606.588571:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 23 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836606.588609:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:1.0:1788836606.588619:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2395:x1875730770258048:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836606.588634:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836606.588651:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 23 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.588674:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 23 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.588696:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:1.0:1788836606.588701:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.588709:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.588717:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.588734:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836606.588782:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2395:x1875730770258048:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 164us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.588789:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00010000:00010000:3.0:1788836606.588918:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6800/0xf7b38383a6554c3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa537 expref: 22 pid: 10681 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.588932:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902400:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836606.588950:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.588959:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.588965:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.588976:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.588983:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.588995:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589001:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.589006:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589554:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589566:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.589569:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836606.589573:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589579:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554cf3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589588:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589595:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589600:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589606:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836606.589609:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589626:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589635:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf439d0200) 00010000:00010000:3.0:1788836606.589637:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836606.589640:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.589646:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554ce5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836606.589793:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12390:x1875730770257664:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 17024us (17157us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788836606.589802:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000020:00080000:3.0:1788836606.589806:0:10333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788836606.590086:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836606.590091:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836606.590762:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788836606.590772:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836606.592727:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.592896:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258304 00000100:00100000:2.0:1788836606.592904:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258304 00000100:00100000:2.0:1788836606.592949:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:2.0:1788836606.592960:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12390:x1875730770258304:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836606.593254:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836606.593288:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788836606.593529:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593544:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593552:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593559:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593563:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593567:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836606.593580:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836606.593603:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836606.593610:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.593616:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836606.593619:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.593626:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.593638:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:3.0:1788836606.593642:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836606.593646:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.593662:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554cfa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836606.593675:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836606.593677:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836606.593678:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836606.593720:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:12390:x1875730770258304:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 761us (1000us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788836606.593729:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000020:00080000:2.0:1788836606.593733:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788836606.723998:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782902528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836606.724091:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836606.724148:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782902656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836606.724184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836606.734290:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782902528 00000100:00100000:1.0:1788836606.734304:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782902528 00000100:00100000:1.0:1788836606.734374:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782902656 00000100:00100000:1.0:1788836606.734378:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782902656 00000100:00100000:1.0:1788836606.734396:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788836606.734406:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782902528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836606.734442:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836606.734517:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782902528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (10426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.734524:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788836606.734541:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788836606.734561:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782902656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836606.734572:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836606.734600:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782902656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (10416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.734606:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788836606.734657:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782902528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836606.734673:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade41ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782902656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836606.736516:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788836606.864274:0:14696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836606.864284:0:14696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836606.864312:0:14696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788836606.864317:0:14696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836606.921474:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.921520:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.921544:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.921563:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.921582:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836606.921781:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258688 00000100:00100000:2.0:1788836606.921792:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258688 00000100:00100000:2.0:1788836606.921862:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788836606.921872:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2396:x1875730770258688:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836606.921945:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2396:x1875730770258688:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.921953:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788836606.921975:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258944 00000100:00100000:2.0:1788836606.921979:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258944 00000100:00100000:2.0:1788836606.922005:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258560 00000100:00100000:2.0:1788836606.922008:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258560 00000100:00100000:2.0:1788836606.922055:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258816 00000100:00100000:2.0:1788836606.922058:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258816 00000100:00100000:2.0:1788836606.922076:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 346 00000100:00100000:2.0:1788836606.922083:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770258944:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836606.922209:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770258432 00000100:00100000:1.0:1788836606.922214:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770258432 00000100:00100000:1.0:1788836606.922241:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 395 00000100:00100000:1.0:1788836606.922247:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770258432:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836606.922273:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2396:x1875730770258432:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.922279:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 395 00000100:00100000:1.0:1788836606.922308:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 347 00000100:00100000:1.0:1788836606.922314:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770258560:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836606.922337:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2396:x1875730770258560:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.922343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 347 00000100:00100000:1.0:1788836606.922355:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 348 00000100:00100000:1.0:1788836606.922361:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770258816:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836606.922381:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770258816:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 20us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836606.922399:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 348 00000100:00080000:3.0:1788836606.924333:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836606.924342:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836606.924345:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836606.925411:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2396:x1875730770258944:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 3318us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836606.925442:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 346 00000100:00100000:0.0:1788836606.987561:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836606.987702:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770259200 00000100:00100000:1.0:1788836606.987713:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770259200 00000100:00100000:1.0:1788836606.987772:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:1.0:1788836606.987782:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:12400:x1875730770259200:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836606.987808:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836606.987827:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa56f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.987933:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6000/0xf7b38383a6554d08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.987950:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6000/0xf7b38383a6554d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.987961:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6000/0xf7b38383a6554d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836606.987973:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788836606.988103:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa56f expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.988120:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6000/0xf7b38383a6554d08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa56f expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836606.988129:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836606.988132:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836606.988136:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6000, rc 0) 00000100:00100000:1.0:1788836606.988214:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:12400:x1875730770259200:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 433us (661us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788836606.988222:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:3.0:1788836606.998339:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.001463:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770259328 00000100:00100000:0.0:1788836607.001479:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770259328 00000100:00100000:0.0:1788836607.001602:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:0.0:1788836607.001613:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:12400:x1875730770259328:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788836607.001696:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001715:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001726:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001740:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001747:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001761:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001851:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001859:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001865:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836607.001908:0:10333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001921:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001928:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001934:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001939:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.001942:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001949:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001959:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836607.001967:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.001972:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001979:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001990:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.001995:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002000:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002004:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.002007:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002033:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002040:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adf4b4fbc00) 00010000:00010000:0.0:1788836607.002043:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.002045:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002050:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002063:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002072:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002077:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002082:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.002084:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002089:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002106:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fb300) 00010000:00010000:0.0:1788836607.002108:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.002111:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.002116:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.002186:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:12400:x1875730770259328:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 574us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.002195:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00080000:3.0:1788836607.014920:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836607.054130:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.054175:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770259584 00000100:00100000:0.0:1788836607.054184:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770259584 00000100:00100000:0.0:1788836607.054251:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:0.0:1788836607.054261:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+25:12403:x1875730770259584:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836607.054297:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836607.054318:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa576 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054393:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054406:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054417:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054444:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054451:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054458:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054562:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054570:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.054577:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836607.054586:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788836607.055488:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055498:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055504:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055510:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.055515:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055523:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055535:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836607.055538:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.055542:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055548:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554d32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055560:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055566:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055571:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055575:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.055586:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055592:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055600:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adf4b4fb300) 00010000:00010000:0.0:1788836607.055603:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.055607:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055612:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554d39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055956:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554d2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 28 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055970:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.055977:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:0.0:1788836607.055980:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836607.055983:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993e00, rc 0) 00000100:00100000:0.0:1788836607.056076:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12403:x1875730770259584:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1815us (1955us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788836607.056085:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:3.0:1788836607.058894:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.058954:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770259712 00000100:00100000:1.0:1788836607.058966:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770259712 00000100:00100000:1.0:1788836607.059039:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:1.0:1788836607.059050:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12403:x1875730770259712:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788836607.059129:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059145:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059155:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059189:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059196:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059210:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059217:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae6a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836607.059223:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059231:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059264:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:1.0:1788836607.059267:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836607.059273:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.059279:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6a00/0xf7b38383a6554d4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.059364:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12403:x1875730770259712:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 316us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836607.059372:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:3.0:1788836607.066712:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.066783:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770259968 00000100:00100000:0.0:1788836607.066794:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770259968 00000100:00100000:0.0:1788836607.066871:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1788836607.066882:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12403:x1875730770259968:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836607.067142:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:12403:x1875730770259968:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 261us (441us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788836607.067150:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1788836607.095784:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.095871:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260224 00000100:00100000:3.0:1788836607.095883:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260224 00000100:00100000:3.0:1788836607.095950:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:3.0:1788836607.095961:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:11936:x1875730770260224:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836607.095986:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836607.096005:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554d55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa57d expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.096161:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.096175:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 29 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.096183:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.096242:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 29 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.096255:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 29 pid: 6490 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.096268:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902784:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836607.096347:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836607.099213:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.099306:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902784:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836607.099334:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836607.099928:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260352 00000100:00100000:2.0:1788836607.099935:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260352 00010000:00010000:2.0:1788836607.099966:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 30 pid: 6490 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836607.100160:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1788836607.100168:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:2394:x1875730770260352:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836607.100181:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836607.100188:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 30 pid: 6490 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100210:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 30 pid: 6490 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100232:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa576 expref: 30 pid: 6490 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100248:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:2.0:1788836607.100253:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100262:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100269:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.100330:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836607.100385:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade41ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:2394:x1875730770260352:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 217us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836607.100392:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00010000:00010000:0.0:1788836607.102282:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.102298:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836607.102323:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788836607.102940:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554d55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 30 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.102960:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 29 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.102968:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:0.0:1788836607.102971:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836607.102974:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701800, rc 0) 00000100:00100000:0.0:1788836607.103061:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:11936:x1875730770260224:12345-192.168.201.38@tcp:101:bash.0 Request processed in 7102us (7289us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788836607.103070:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:0.0:1788836607.105970:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.106150:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260480 00000100:00100000:3.0:1788836607.106161:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260480 00000100:00100000:3.0:1788836607.106226:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:3.0:1788836607.106238:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:11936:x1875730770260480:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836607.106263:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836607.106283:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa584 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106318:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106331:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106342:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106484:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa584 expref: 31 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106503:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa584 expref: 30 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.106511:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:3.0:1788836607.106514:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836607.106517:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836607.106578:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11936:x1875730770260480:12345-192.168.201.38@tcp:101:bash.0 Request processed in 342us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.106584:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:3.0:1788836607.110134:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.110618:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260736 00000100:00100000:1.0:1788836607.110638:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260736 00000100:00100000:1.0:1788836607.110701:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:1.0:1788836607.110711:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:11936:x1875730770260736:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1788836607.110940:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.110958:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.110970:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836607.111048:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788836607.111072:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002768b848 reply state 00000000fdc57e7d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.111318:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.111326:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:1.0:1788836607.111328:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836607.111332:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788836607.111376:0:10681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788836607.111575:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:11936:x1875730770260736:12345-192.168.201.38@tcp:36:bash.0 Request processed in 863us (1449us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788836607.111583:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000020:00080000:1.0:1788836607.111587:0:10681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788836607.114347:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.114442:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260864 00000100:00100000:2.0:1788836607.114467:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260864 00000100:00100000:2.0:1788836607.114557:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:2.0:1788836607.114568:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+34:11936:x1875730770260864:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836607.114595:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.114619:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554d7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa58b expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.114688:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa58b expref: 35 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.114704:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa58b expref: 35 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.114724:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:2.0:1788836607.114727:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836607.114732:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836607.114792:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:11936:x1875730770260864:12345-192.168.201.38@tcp:101:bash.0 Request processed in 226us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836607.114800:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:3.0:1788836607.116952:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.117065:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770260992 00000100:00100000:1.0:1788836607.117075:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770260992 00000100:00100000:1.0:1788836607.117129:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788836607.117139:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:11936:x1875730770260992:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836607.117156:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836607.117179:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa592 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836607.117241:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7afd, atime: 0x6a9f7afb, ctime: 0x6a9f7afd, blocks: 0x8 00010000:00010000:1.0:1788836607.117264:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788836607.117269:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836607.117277:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.117297:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.117327:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6a00, rc 0) 00000100:00100000:1.0:1788836607.117384:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:11936:x1875730770260992:12345-192.168.201.38@tcp:101:bash.0 Request processed in 246us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836607.117391:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1788836607.119946:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.120053:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770261120 00000100:00100000:0.0:1788836607.120065:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770261120 00002000:00010000:0.0:1788836607.120122:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788836607.120127:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade44627b80 with x1875730770261120 ext(0->18446744073709551615) 00002000:00010000:0.0:1788836607.120152:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade44627b80. 00000100:00100000:0.0:1788836607.120188:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788836607.120208:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2397:x1875730770261120:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:0.0:1788836607.120474:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788836607.120478:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788836605 -> 1788836607 00002000:00010000:0.0:1788836607.120480:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788836603 -> 1788836603 00002000:00010000:0.0:1788836607.120482:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788836605 -> 1788836607 00002000:00010000:0.0:1788836607.120484:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788836607.120546:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2397:x1875730770261120:12345-192.168.201.38@tcp:10:bash.0 Request processed in 349us (612us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788836607.120554:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00002000:00010000:0.0:1788836607.120557:0:8411:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788836607.120559:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade44627b80 with x1875730770261120 ext(0->18446744073709551615) 00002000:00010000:0.0:1788836607.120565:0:8411:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade44627b80. 00000100:00100000:1.0:1788836607.195671:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.195807:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770261248 00000100:00100000:3.0:1788836607.195818:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770261248 00000100:00100000:3.0:1788836607.195882:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:3.0:1788836607.195893:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:12417:x1875730770261248:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788836607.195968:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.195987:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.195998:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196074:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196083:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196100:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196177:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196186:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196193:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836607.196249:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196259:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196265:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196271:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196277:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.196281:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196295:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196307:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:3.0:1788836607.196310:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836607.196315:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196321:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554d8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196334:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196340:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196346:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196351:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.196354:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196360:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196368:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.196370:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836607.196372:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196392:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554d94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196407:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196412:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196417:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196435:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.196438:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196443:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196451:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:3.0:1788836607.196453:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836607.196456:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.196461:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.196529:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:12417:x1875730770261248:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 637us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.196536:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:1.0:1788836607.232633:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.232832:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770261504 00000100:00100000:2.0:1788836607.232845:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770261504 00000100:00100000:2.0:1788836607.232908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:2.0:1788836607.232919:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+35:12420:x1875730770261504:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836607.232946:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.232971:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554da2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa599 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233089:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233130:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233141:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233158:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233166:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233171:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233300:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554db7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233309:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233315:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836607.233324:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788836607.233401:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233409:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233414:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233439:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836607.233444:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233451:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233465:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836607.233468:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836607.233472:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233478:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554da9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233493:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233498:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233504:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233508:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836607.233511:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233516:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233533:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273b700) 00010000:00010000:2.0:1788836607.233535:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836607.233537:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233543:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233582:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554da2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa599 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233595:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa599 expref: 37 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.233602:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:2.0:1788836607.233604:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788836607.233606:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030a00, rc 0) 00000100:00100000:2.0:1788836607.233914:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12420:x1875730770261504:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 996us (1301us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788836607.233922:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:0.0:1788836607.237455:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.237584:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770261632 00000100:00100000:3.0:1788836607.237594:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770261632 00000100:00100000:3.0:1788836607.237661:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:3.0:1788836607.237670:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12420:x1875730770261632:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788836607.237736:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.237752:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 37 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.237761:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.237791:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 37 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.237805:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 37 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.237816:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902912:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836607.237913:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836607.246218:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10333:1875730782902912:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836607.246253:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.246890:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.247240:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770261888 00000100:00100000:1.0:1788836607.247250:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770261888 00000100:00100000:1.0:1788836607.247311:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836607.247321:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:6168:x1875730770261888:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836607.247614:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:6168:x1875730770261888:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 293us (725us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788836607.247631:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836607.250161:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.252242:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770262016 00000100:00100000:3.0:1788836607.252257:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770262016 00010000:00010000:3.0:1788836607.252307:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 39 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.252374:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:3.0:1788836607.252385:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:2394:x1875730770262016:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836607.252400:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836607.252408:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 39 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252434:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 39 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252456:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554d5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa57d expref: 39 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252472:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:3.0:1788836607.252477:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252487:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252494:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.252530:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836607.252597:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:2394:x1875730770262016:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 213us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.252604:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00010000:00010000:0.0:1788836607.252775:0:10333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252784:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252823:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252830:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252847:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252852:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.252857:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252864:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252873:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:0.0:1788836607.252876:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836607.252879:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.252884:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554dc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.252924:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12420:x1875730770261632:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 15255us (15481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.252933:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:3.0:1788836607.257548:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.257766:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770262272 00000100:00100000:1.0:1788836607.257777:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770262272 00000100:00100000:1.0:1788836607.257835:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788836607.257845:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+37:12420:x1875730770262272:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788836607.258109:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:12420:x1875730770262272:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 265us (570us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788836607.258117:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1788836607.359368:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.359475:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770262528 00000100:00100000:0.0:1788836607.359485:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770262528 00000100:00100000:0.0:1788836607.359548:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:0.0:1788836607.359559:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+38:12431:x1875730770262528:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788836607.359586:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836607.359607:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554dcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5a0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359720:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359735:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359745:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359760:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359767:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359774:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359883:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554de1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359893:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359901:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836607.359910:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788836607.359983:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.359990:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360002:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360007:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.360049:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360058:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360070:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836607.360074:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.360079:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360084:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554dd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360097:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360103:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360109:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360115:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.360118:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360134:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360143:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adf4b4fb300) 00010000:00010000:0.0:1788836607.360145:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.360148:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360153:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554dda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360203:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554dcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a0 expref: 41 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360217:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a0 expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.360223:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:0.0:1788836607.360225:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836607.360227:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993e00, rc 0) 00000100:00100000:0.0:1788836607.360282:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12431:x1875730770262528:12345-192.168.201.38@tcp:101:cat.0 Request processed in 725us (924us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788836607.360290:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 213 00010000:00010000:1.0:1788836607.364052:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836607.365889:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.365971:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770262784 00000100:00100000:1.0:1788836607.365981:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770262784 00000100:00100000:1.0:1788836607.366079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:1.0:1788836607.366095:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+40:12431:x1875730770262784:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1788836607.366372:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:12431:x1875730770262784:12345-192.168.201.38@tcp:35:cat.0 Request processed in 284us (494us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788836607.366380:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:3.0:1788836607.384122:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.384281:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263040 00000100:00100000:1.0:1788836607.384292:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263040 00000100:00100000:1.0:1788836607.384357:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:1.0:1788836607.384368:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+41:12432:x1875730770263040:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:1.0:1788836607.384554:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788836607.384582:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554d7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa58b expref: 41 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384603:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a6554de1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a0 expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384614:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554db7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa599 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384635:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa584 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384645:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:1.0:1788836607.384649:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836607.384671:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384700:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384709:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384723:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384730:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384736:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384818:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384826:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.384833:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836607.385077:0:10681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:1.0:1788836607.385141:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385150:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385157:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385170:0:10681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385177:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385184:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385216:0:10681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836607.385235:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385241:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385248:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385253:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836607.385258:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385265:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385275:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:1.0:1788836607.385277:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788836607.385280:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385296:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554dfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385311:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385317:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385323:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385328:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae6e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836607.385332:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385338:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385346:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836607.385348:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836607.385352:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385357:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554def lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836607.385367:0:10681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069c2ba7a reply state 0000000053009b96 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385377:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.385390:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:1.0:1788836607.385392:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836607.385395:0:10681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836607.385607:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836607.385623:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.385630:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836607.385634:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.385640:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.385649:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:3.0:1788836607.385651:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836607.385655:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.385660:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554e04 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.385670:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836607.385671:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836607.385673:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836607.386372:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:12432:x1875730770263040:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2001us (2255us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788836607.386382:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:3.0:1788836607.450812:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.451238:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263296 00000100:00100000:2.0:1788836607.451249:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263296 00000100:00100000:2.0:1788836607.451326:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:2.0:1788836607.451352:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+39:12438:x1875730770263296:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836607.451378:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.451397:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554e0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5a7 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451514:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451530:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451542:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451553:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451560:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.451566:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836607.451883:0:12185:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788836607.452087:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452097:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452105:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452146:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452153:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452161:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452167:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836607.452171:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452178:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452190:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836607.452203:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836607.452208:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452214:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554e12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836607.452230:0:12185:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cffe0b50 reply state 00000000caf8e97b transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452241:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452248:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:2.0:1788836607.452257:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836607.452260:0:12185:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788836607.452289:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554e0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 42 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452304:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 41 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.452312:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836607.452315:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836607.452317:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836607.452389:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:12438:x1875730770263296:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1040us (1589us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788836607.452397:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:1.0:1788836607.455587:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.455835:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263424 00000100:00100000:2.0:1788836607.455845:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263424 00000100:00100000:2.0:1788836607.455904:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:2.0:1788836607.455915:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770263424:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836607.455934:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.455955:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5ae expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836607.455982:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836607.456004:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1788836607.456009:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836607.456037:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.456091:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.456106:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031400, rc 0) 00000100:00100000:2.0:1788836607.456165:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770263424:12345-192.168.201.38@tcp:101:bash.0 Request processed in 251us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836607.456172:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1788836607.458550:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.458714:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263552 00000100:00100000:1.0:1788836607.458724:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263552 00000100:00100000:1.0:1788836607.458791:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:1.0:1788836607.458800:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:12438:x1875730770263552:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836607.458820:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836607.458839:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5b5 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.458867:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 9 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.458876:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836607.458881:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836607.458886:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.458922:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 9 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.458936:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 9 pid: 8407 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.458970:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8408:1875730782903040:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836607.459387:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836607.468494:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8408:1875730782903040:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836607.468534:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.468557:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6e00, rc 0) 00000100:00100000:2.0:1788836607.469583:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.469649:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263680 00000100:00100000:3.0:1788836607.469658:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263680 00010000:00010000:3.0:1788836607.469696:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 10 pid: 8407 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.469756:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:3.0:1788836607.469767:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770263680:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836607.469782:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836607.469806:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 10 pid: 8407 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.469819:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 10 pid: 8407 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.469841:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b16613/0xf7b38383a6554e2e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ae expref: 10 pid: 8407 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.469859:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836607.469863:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836607.469871:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.469881:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.469915:0:13174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.469930:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13174:1875730782903168:192.168.201.38@tcp:105: 00000100:00100000:3.0:1788836607.470003:0:13174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836607.471257:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13174:1875730782903168:192.168.201.38@tcp:105: 00010000:00010000:3.0:1788836607.471278:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836607.471315:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770263680:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1550us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.471325:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:1.0:1788836607.473333:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:12438:x1875730770263552:12345-192.168.201.38@tcp:101:bash.0 Request processed in 14523us (14781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836607.473346:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:3.0:1788836607.476480:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.478738:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770263936 00000100:00100000:1.0:1788836607.478753:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770263936 00000100:00100000:1.0:1788836607.478837:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:1.0:1788836607.478849:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+42:12438:x1875730770263936:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:1.0:1788836607.479213:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:12438:x1875730770263936:12345-192.168.201.38@tcp:35:bash.0 Request processed in 366us (2743us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788836607.479222:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1788836607.634242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.634408:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264064 00000100:00100000:0.0:1788836607.634419:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264064 00000100:00100000:0.0:1788836607.634484:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:0.0:1788836607.634497:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+43:12454:x1875730770264064:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788836607.634542:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836607.634565:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5bc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634628:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634643:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634654:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836607.634704:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788836607.634708:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836607.634728:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634749:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6554e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5bc expref: 45 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634763:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5bc expref: 44 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.634769:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836607.634771:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836607.634774:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992400, rc 0) 00000100:00100000:0.0:1788836607.634823:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:12454:x1875730770264064:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 331us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.634830:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:3.0:1788836607.639506:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.639584:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264320 00000100:00100000:1.0:1788836607.639597:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264320 00000100:00100000:1.0:1788836607.639657:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:1.0:1788836607.639667:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+44:12454:x1875730770264320:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836607.639690:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836607.639711:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554e4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5c3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.639852:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554e51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.639867:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.639877:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836607.639887:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788836607.639985:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554e4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5c3 expref: 47 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.640003:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5c3 expref: 46 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.640035:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:1.0:1788836607.640039:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836607.640042:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7c00, rc 0) 00000100:00100000:1.0:1788836607.640657:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:12454:x1875730770264320:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 987us (1157us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788836607.640666:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:3.0:1788836607.643591:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.643722:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.643750:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264704 00000100:00100000:3.0:1788836607.643759:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264704 00000100:00100000:3.0:1788836607.643828:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788836607.643838:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+46:2395:x1875730770264704:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836607.643855:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836607.643878:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7c00/0xf7b38383a6554e51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5c3 expref: 46 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.643896:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:3.0:1788836607.643901:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836607.643945:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:2395:x1875730770264704:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.643951:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788836607.644199:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264576 00000100:00100000:2.0:1788836607.644204:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264576 00000100:00100000:2.0:1788836607.644273:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:2.0:1788836607.644281:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+45:12454:x1875730770264576:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836607.644301:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.644318:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554e5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5ca expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.644409:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.644438:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.644448:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836607.644459:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788836607.644570:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554e5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ca expref: 48 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.644588:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ca expref: 47 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.644596:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836607.644599:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836607.644601:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82044a00, rc 0) 00000100:00100000:2.0:1788836607.644846:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:12454:x1875730770264576:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 565us (1262us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788836607.644854:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:2.0:1788836607.663816:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.663926:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264832 00000100:00100000:1.0:1788836607.663938:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264832 00000100:00100000:1.0:1788836607.663999:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788836607.664035:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2396:x1875730770264832:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:1.0:1788836607.664095:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.664128:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.664136:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836607.664140:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836607.664144:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.664179:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.664202:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 8 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.664217:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782903296:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836607.664295:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836607.667797:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8405:1875730782903296:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836607.667832:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836607.669552:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.670481:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770264960 00000100:00100000:0.0:1788836607.670494:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770264960 00002000:00100000:0.0:1788836607.670551:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ade447ca680 x1875730770264960/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:18/0 lens 504/0 e 0 to 0 dl 1788836618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836607.670563:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade447ca680 with x1875730770264960 ext(0->8) 00010000:00010000:0.0:1788836607.670573:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.670590:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 9 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836607.670598:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade447ca680 00000100:00100000:0.0:1788836607.670648:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788836607.670658:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2394:x1875730770264960:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:0.0:1788836607.672293:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2394:x1875730770264960:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 1627us (2740us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788836607.672306:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00002000:00100000:0.0:1788836607.672317:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ade447ca680 x1875730770264960/t4294967309(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:18/0 lens 504/448 e 0 to 0 dl 1788836618 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836607.672327:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade447ca680 with x1875730770264960 ext(0->8) 00010000:00010000:0.0:1788836607.672336:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.672353:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836607.672379:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ade447ca680 00000100:00100000:0.0:1788836607.674501:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.674589:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265088 00000100:00100000:3.0:1788836607.674599:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265088 00010000:00010000:3.0:1788836607.674657:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.674698:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:3.0:1788836607.674708:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2395:x1875730770265088:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836607.674723:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788836607.674741:0:13174:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788836607.674745:0:13174:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788836607 00002000:00010000:3.0:1788836607.674747:0:13174:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788836607 00002000:00010000:3.0:1788836607.674749:0:13174:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788836607 00002000:00010000:3.0:1788836607.674751:0:13174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788836607.674757:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.674769:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.674791:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000855705c0/0xf7b38383a6554e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5b5 expref: 11 pid: 8408 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.674807:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836607.674812:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836607.674817:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.674827:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.674872:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836607.674929:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770265088:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 222us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.674937:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00010000:00010000:1.0:1788836607.675057:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675067:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675103:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675112:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675120:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675127:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836607.675132:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675140:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675152:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.675159:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012536571/0xf7b38383a6554e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.675215:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2396:x1875730770264832:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 11207us (11409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836607.675223:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1788836607.678184:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.678413:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265344 00000100:00100000:1.0:1788836607.678434:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265344 00000100:00100000:1.0:1788836607.678493:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:1.0:1788836607.678503:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+47:12454:x1875730770265344:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1788836607.678563:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ca expref: 47 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836607.678733:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788836607.678765:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788836607.679109:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788836607.679146:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.679162:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 51 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.679171:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.679221:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 51 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.679236:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 51 pid: 12185 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.679253:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782903424:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836607.679343:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836607.681849:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1875730782903424:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836607.681893:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.683392:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.683821:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265472 00000100:00100000:0.0:1788836607.683831:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265472 00010000:00010000:0.0:1788836607.683868:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 52 pid: 12185 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.683910:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:0.0:1788836607.683920:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+52:2394:x1875730770265472:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836607.683935:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836607.683941:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 52 pid: 12185 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.683952:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 52 pid: 12185 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.683973:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5a7 expref: 52 pid: 12185 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.683989:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:0.0:1788836607.683993:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.684002:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.684046:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.684090:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836607.684213:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.684221:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836607.684334:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788836607.684445:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788836607.684529:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782903552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788836607.684577:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836607.684605:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836607.684651:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782903552 00000100:00100000:2.0:1788836607.684656:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782903552 00000100:00100000:2.0:1788836607.684683:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788836607.684689:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1875730782903552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788836607.684758:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6493:x1875730782903552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836607.684765:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788836607.684804:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782903552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788836607.684905:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788836607.684941:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782903680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788836607.684965:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836607.684988:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782903680 00000100:00100000:2.0:1788836607.684992:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782903680 00000100:00100000:2.0:1788836607.685042:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788836607.685048:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6493:x1875730782903680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788836607.685129:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6493:x1875730782903680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (163us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788836607.685136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788836607.685152:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836607.685169:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1875730782903680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788836607.685209:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788836607.685237:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685245:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685252:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685258:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae6400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836607.685268:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685276:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685288:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836607.685291:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788836607.685295:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.685301:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6400/0xf7b38383a6554e7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836607.685389:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788836607.685465:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788836607.685478:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391591465245ns, next at 392591463180ns, rc = 0 00000001:00080000:2.0:1788836607.685484:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788836607.685504:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836607.685507:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836607.685513:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554e66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ca expref: 56 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.685632:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:2394:x1875730770265472:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1712us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.685641:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:2.0:1788836607.685815:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12454:x1875730770265344:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 7314us (7640us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788836607.685824:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000020:00080000:2.0:1788836607.685828:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788836607.688568:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.688645:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265600 00000100:00100000:3.0:1788836607.688653:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265600 00000100:00100000:3.0:1788836607.688702:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:3.0:1788836607.688711:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+54:12454:x1875730770265600:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836607.688732:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836607.688754:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554e82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5d1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.688806:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554e82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d1 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.688820:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554e82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d1 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.688836:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.688839:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836607.688843:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700c00, rc 0) 00000100:00100000:3.0:1788836607.688923:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:12454:x1875730770265600:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 213us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.688930:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:3.0:1788836607.691788:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.691885:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265856 00000100:00100000:0.0:1788836607.691895:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265856 00000100:00100000:0.0:1788836607.691989:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788836607.692000:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+55:12454:x1875730770265856:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836607.692289:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12454:x1875730770265856:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 290us (510us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788836607.692296:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788836607.742287:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836607.742311:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782903808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836607.742393:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836607.742527:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782903808 00000100:00100000:0.0:1788836607.742535:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782903808 00000100:00100000:0.0:1788836607.742575:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788836607.742582:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782903808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836607.742611:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788836607.742661:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782903808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.742665:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788836607.742817:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782903808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836607.778295:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836607.778393:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770265984 00000100:00100000:0.0:1788836607.778404:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770265984 00000100:00100000:0.0:1788836607.778646:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:0.0:1788836607.778658:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12464:x1875730770265984:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788836607.778866:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.778894:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.778905:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.778917:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.778925:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.778931:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779004:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779048:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779056:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836607.779104:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779116:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779122:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779138:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779144:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.779148:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779155:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779167:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836607.779170:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.779174:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779181:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6554e89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779202:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779208:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779214:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779219:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.779221:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779235:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779243:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:0.0:1788836607.779245:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.779248:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779254:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554e90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779263:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779269:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779275:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779280:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836607.779283:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779288:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779294:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836607.779296:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836607.779299:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836607.779312:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993000/0xf7b38383a6554e97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.779789:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12464:x1875730770265984:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1129us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836607.779798:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:1.0:1788836607.818414:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.819553:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770266240 00000100:00100000:3.0:1788836607.819565:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770266240 00000100:00100000:3.0:1788836607.819640:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:3.0:1788836607.819651:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf46eba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+56:12467:x1875730770266240:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836607.819673:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836607.819707:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554e9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5d8 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819788:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819803:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819815:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819827:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819836:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819843:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819982:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819992:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.819999:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836607.820051:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788836607.820440:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820447:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820453:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820459:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.820463:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820471:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820484:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:3.0:1788836607.820487:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836607.820492:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820508:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701200/0xf7b38383a6554ea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820527:0:10333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820532:0:10333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820537:0:10333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820541:0:10333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.820544:0:10333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820549:0:10333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820556:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:3.0:1788836607.820558:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836607.820560:0:10333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820565:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700a00/0xf7b38383a6554eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820599:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6554e9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 59 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820833:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 58 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.820840:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.820843:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836607.820845:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700400, rc 0) 00000100:00100000:3.0:1788836607.820914:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf46eba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:12467:x1875730770266240:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1265us (2511us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788836607.820922:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:2.0:1788836607.825523:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.825874:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770266368 00000100:00100000:3.0:1788836607.825884:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770266368 00000100:00100000:3.0:1788836607.825941:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:3.0:1788836607.825952:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:12467:x1875730770266368:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788836607.826033:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826051:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826062:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826519:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826529:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826554:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826561:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836607.826565:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826572:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826584:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.826587:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836607.826591:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.826597:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701e00/0xf7b38383a6554ec1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.826681:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:12467:x1875730770266368:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 729us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.826688:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:1.0:1788836607.828481:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.828578:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770266624 00000100:00100000:2.0:1788836607.828587:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770266624 00000100:00100000:2.0:1788836607.828669:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:2.0:1788836607.828679:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+58:12467:x1875730770266624:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788836607.828909:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12467:x1875730770266624:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 230us (435us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788836607.828917:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1788836607.925137:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.925234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770266880 00000100:00100000:2.0:1788836607.925243:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770266880 00000100:00100000:2.0:1788836607.925301:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:2.0:1788836607.925311:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12477:x1875730770266880:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836607.925335:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.925338:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788836607.925377:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a6554e43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5bc expref: 59 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925397:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836607.925401:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836607.925416:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554ec8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5df expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925525:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925538:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 59 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925547:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925596:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 59 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.925765:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 59 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836607.925780:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782903936:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836607.925884:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836607.928918:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782903936:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836607.928950:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.931123:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836607.931408:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267008 00000100:00100000:3.0:1788836607.931419:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267008 00010000:00010000:3.0:1788836607.931475:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 60 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836607.931514:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:3.0:1788836607.931525:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:2395:x1875730770267008:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836607.931540:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836607.931560:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 60 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931573:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 60 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931596:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554eb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d8 expref: 60 pid: 10333 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931622:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.931627:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931636:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931643:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.931673:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836607.931729:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:2395:x1875730770267008:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 206us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.931737:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00010000:00010000:1.0:1788836607.932213:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.932228:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836607.932251:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788836607.932401:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554ec8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.932430:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 59 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.932439:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836607.932442:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836607.932445:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82045600, rc 0) 00000100:00100000:1.0:1788836607.932483:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12477:x1875730770266880:12345-192.168.201.38@tcp:101:bash.0 Request processed in 7173us (7355us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788836607.932490:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:1.0:1788836607.936486:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.936557:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267136 00000100:00100000:2.0:1788836607.936567:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267136 00000100:00100000:2.0:1788836607.936631:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:2.0:1788836607.936642:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+59:12477:x1875730770267136:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836607.936665:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836607.936684:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554edd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5e6 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936718:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936730:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936740:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936859:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 61 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936880:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 60 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.936888:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836607.936891:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836607.936895:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82044a00, rc 0) 00000100:00100000:2.0:1788836607.936946:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12477:x1875730770267136:12345-192.168.201.38@tcp:101:bash.0 Request processed in 307us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836607.936953:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:3.0:1788836607.943989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.944124:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267392 00000100:00100000:2.0:1788836607.944134:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267392 00000100:00100000:2.0:1788836607.944204:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:2.0:1788836607.944214:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+60:12477:x1875730770267392:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:2.0:1788836607.944457:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.944474:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.944485:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836607.944529:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788836607.944552:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002768b848 reply state 00000000bed4bea1 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.944581:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836607.944588:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836607.944590:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836607.944594:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836607.944698:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12477:x1875730770267392:12345-192.168.201.38@tcp:36:bash.0 Request processed in 485us (718us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788836607.944706:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 225 00000020:00080000:2.0:1788836607.944710:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788836607.947518:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.947639:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267520 00000100:00100000:1.0:1788836607.947660:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267520 00000100:00100000:1.0:1788836607.947720:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:1.0:1788836607.947730:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12477:x1875730770267520:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788836607.947754:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836607.947773:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554ef2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5ed expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.947862:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.947876:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.947884:0:10681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.947917:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.947930:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 64 pid: 6492 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.947944:0:10681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782904064:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836607.948328:0:10681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836607.952435:0:10681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1875730782904064:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836607.952465:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836607.954145:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836607.954339:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267648 00000100:00100000:1.0:1788836607.954360:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267648 00010000:00010000:1.0:1788836607.954398:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 65 pid: 6492 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836607.954558:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:1.0:1788836607.954568:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:2394:x1875730770267648:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836607.954584:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836607.954592:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 65 pid: 6492 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954606:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 65 pid: 6492 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954638:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554ecf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5df expref: 65 pid: 6492 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954658:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836607.954663:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954673:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954680:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836607.954709:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836607.954809:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.954817:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836607.954869:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788836607.954880:0:10681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836607.954902:0:10681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.954931:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7400/0xf7b38383a6554ef2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 65 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.954946:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 64 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836607.954954:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836607.954957:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836607.954959:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6e00, rc 0) 00000100:00100000:1.0:1788836607.955094:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+64:2394:x1875730770267648:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 526us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836607.955111:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:3.0:1788836607.955331:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12477:x1875730770267520:12345-192.168.201.38@tcp:101:bash.0 Request processed in 7602us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836607.955339:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:0.0:1788836607.958578:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836607.958734:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770267904 00000100:00100000:2.0:1788836607.958743:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770267904 00000100:00100000:2.0:1788836607.958832:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1788836607.958842:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+63:12477:x1875730770267904:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788836607.959226:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+64:12477:x1875730770267904:12345-192.168.201.38@tcp:35:bash.0 Request processed in 383us (656us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788836607.959233:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1788836608.023230:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.023325:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268032 00000100:00100000:2.0:1788836608.023335:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268032 00000100:00100000:2.0:1788836608.023394:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:2.0:1788836608.023405:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+64:12484:x1875730770268032:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836608.023440:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.023461:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5f4 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023524:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023550:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023561:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836608.023604:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788836608.023608:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836608.023640:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023665:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5f4 expref: 66 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023685:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5f4 expref: 65 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.023693:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836608.023696:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836608.023699:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030600, rc 0) 00000100:00100000:2.0:1788836608.023761:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770268032:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 358us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.023769:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:3.0:1788836608.027264:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.027515:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268160 00000100:00100000:2.0:1788836608.027526:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268160 00000100:00100000:2.0:1788836608.027588:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:2.0:1788836608.027600:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770268160:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836608.027630:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.027666:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554f0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa5fb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027732:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027747:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027758:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027771:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027779:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027785:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027860:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027869:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027875:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836608.027917:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788836608.027921:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836608.027938:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027955:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027963:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027970:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027976:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027982:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82045600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.027986:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.027993:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028005:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836608.028008:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836608.028038:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028044:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045600/0xf7b38383a6554f15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028072:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028078:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028089:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028094:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82045c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.028097:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028104:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028112:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:2.0:1788836608.028115:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836608.028118:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028124:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045c00/0xf7b38383a6554f1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028150:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6554f0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028165:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.028172:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.028174:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836608.028176:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf82045400, rc 0) 00000100:00100000:2.0:1788836608.028243:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12484:x1875730770268160:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 646us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.028259:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:0.0:1788836608.032533:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.032725:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268416 00000100:00100000:2.0:1788836608.032735:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268416 00000100:00100000:2.0:1788836608.032794:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:2.0:1788836608.032804:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12484:x1875730770268416:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836608.032826:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.032848:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554f2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa602 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.032985:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033000:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033044:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033309:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033346:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033359:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.033374:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782904192:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.033490:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.033500:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.033510:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782904320:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836608.033534:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836608.040389:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836608.040575:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268544 00000100:00100000:3.0:1788836608.040585:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268544 00010000:00010000:3.0:1788836608.040636:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 68 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836608.040679:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:3.0:1788836608.040689:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:2395:x1875730770268544:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836608.040704:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836608.040711:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 68 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.040742:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 68 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.040766:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836608.040771:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.040780:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.040787:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836608.040849:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:2395:x1875730770268544:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 160us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836608.040857:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00010000:00010000:2.0:1788836608.043280:0:6492:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.38@tcp) returned -22 from blocking AST (req@00000000b4aff7b2 x1875730782904192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.043317:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82045400/0xf7b38383a6554f23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5fb expref: 67 pid: 6491 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.043336:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782904192:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836608.043349:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782904320:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.043372:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.043378:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.043387:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.043396:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.046884:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.047486:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268672 00000100:00100000:2.0:1788836608.047511:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268672 00010000:00010000:2.0:1788836608.047553:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.047598:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:2.0:1788836608.047620:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:2395:x1875730770268672:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836608.047634:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836608.047641:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047654:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047676:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6e00/0xf7b38383a6554ef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5ed expref: 67 pid: 10681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047695:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.047701:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047711:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047719:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.047752:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836608.047804:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:2395:x1875730770268672:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 196us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.047821:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00010000:00010000:3.0:1788836608.048063:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.048072:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836608.048098:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788836608.048240:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a6554f2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 67 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.048257:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.048264:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836608.048273:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836608.048276:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615ce00, rc 0) 00000100:00100000:3.0:1788836608.048311:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12484:x1875730770268416:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 15509us (15788us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788836608.048318:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:3.0:1788836608.052336:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.052478:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770268928 00000100:00100000:0.0:1788836608.052487:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770268928 00000100:00100000:0.0:1788836608.052547:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788836608.052555:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12484:x1875730770268928:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:0.0:1788836608.052571:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836608.052594:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700c00/0xf7b38383a6554e82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5d1 expref: 66 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.052621:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836608.052626:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836608.052676:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770268928:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836608.052684:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788836608.054764:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.054819:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269056 00000100:00100000:2.0:1788836608.054828:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269056 00000100:00100000:2.0:1788836608.054875:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:2.0:1788836608.054883:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770269056:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:2.0:1788836608.054976:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.054993:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.055003:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836608.055129:0:12185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788836608.055203:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770269056:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 320us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.055210:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:3.0:1788836608.057591:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.058213:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269184 00000100:00100000:2.0:1788836608.058223:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269184 00000100:00100000:2.0:1788836608.058277:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 231 00000100:00100000:2.0:1788836608.058287:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+65:12484:x1875730770269184:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836608.058372:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.058394:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa609 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058457:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058484:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058501:0:6491:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058514:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058527:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.058529:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836608.058533:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.058539:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615de00, rc 0) 00000100:00100000:2.0:1788836608.058637:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12484:x1875730770269184:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 350us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.058645:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 231 00000004:00080000:1.0:1788836608.254462:0:10026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392160446937ns, next at 393160443272ns, rc = 0 00000100:00100000:0.0:1788836608.254541:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782904448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836608.254623:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836608.254885:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782904448 00000100:00100000:1.0:1788836608.254893:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782904448 00000100:00100000:1.0:1788836608.254956:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788836608.254967:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782904448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836608.254995:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788836608.255055:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782904448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.255062:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788836608.255237:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836608.255276:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782904448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836608.255963:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782904576:0@lo:400:kworker.0 00000100:00100000:0.0:1788836608.256007:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.256103:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782904576 00000100:00100000:2.0:1788836608.256108:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782904576 00000100:00100000:2.0:1788836608.256151:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788836608.256159:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782904576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836608.256291:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782904704:0@lo:400:kworker.0 00000100:00100000:1.0:1788836608.256324:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836608.256388:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782904704 00000100:00100000:1.0:1788836608.256393:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782904704 00000100:00100000:1.0:1788836608.256421:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788836608.256428:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782904704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836608.256464:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782904704:12345-0@lo:400:kworker.0 Request processed in 36us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.256470:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788836608.256497:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782904704:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.258554:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782904576:12345-0@lo:400:kworker.0 Request processed in 2388us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.258567:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788836608.258889:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782905216:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.258939:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836608.258964:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782905728:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.258986:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836608.259007:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788836608.259030:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782905088:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.259055:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259213:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782904832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259254:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259276:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782905344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259295:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259310:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782905856:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259330:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259347:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788836608.259352:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782904960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259372:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259388:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782905472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259409:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259426:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782905984:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259446:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.259473:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905472 00000100:00100000:2.0:1788836608.259481:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905472 00000100:00100000:2.0:1788836608.259527:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905984 00000100:00100000:2.0:1788836608.259530:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905984 00000100:00100000:2.0:1788836608.259569:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836608.259577:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782905472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259639:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782905472:12345-0@lo:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.259646:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836608.259659:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788836608.259664:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf8174a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782905984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259687:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf8174a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782905984:12345-0@lo:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.259691:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788836608.259838:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905088 00000100:00100000:2.0:1788836608.259842:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905088 00000100:00100000:2.0:1788836608.259863:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782904832 00000100:00100000:2.0:1788836608.259866:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782904832 00000100:00100000:2.0:1788836608.259878:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788836608.259883:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782905088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259915:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782905088:12345-0@lo:400:kworker.0 Request processed in 32us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.259921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788836608.259933:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788836608.259939:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782904832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.259966:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782904832:12345-0@lo:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.259970:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788836608.260009:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782905472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.260045:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782905984:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.260054:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782904832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.262888:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905216 00000100:00100000:2.0:1788836608.262906:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905216 00000100:00100000:2.0:1788836608.262969:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905728 00000100:00100000:2.0:1788836608.262972:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905728 00000100:00100000:2.0:1788836608.262990:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905344 00000100:00100000:2.0:1788836608.262993:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905344 00000100:00100000:2.0:1788836608.263005:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905856 00000100:00100000:2.0:1788836608.263008:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905856 00000100:00100000:2.0:1788836608.263037:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782904960 00000100:00100000:2.0:1788836608.263040:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782904960 00000100:00100000:2.0:1788836608.263057:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788836608.264518:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782905216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.264625:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782905216:12345-0@lo:400:kworker.0 Request processed in 121us (5687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.264633:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788836608.264670:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788836608.264676:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782905728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.264704:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782905728:12345-0@lo:400:kworker.0 Request processed in 29us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.264709:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788836608.264720:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788836608.264726:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782905344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.265203:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782905344:12345-0@lo:400:kworker.0 Request processed in 475us (5905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.265210:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788836608.265228:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788836608.265236:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782905856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.265266:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782905856:12345-0@lo:400:kworker.0 Request processed in 32us (5935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.265273:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788836608.265286:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788836608.265292:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782904960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836608.265320:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782904960:12345-0@lo:400:kworker.0 Request processed in 29us (5947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.265325:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788836608.265378:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782904960:0@lo:400:kworker.0 00010000:00080000:2.0:1788836608.265409:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44625180 x1875730782905344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836608.265421:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782905344:0@lo:400:kworker.0 00010000:00080000:2.0:1788836608.265431:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7a755500 x1875730782905856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836608.265439:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782905856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.265594:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782905600:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.265645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836608.265677:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782905216:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.265688:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782905728:0@lo:400:kworker.0 00000100:00100000:3.0:1788836608.265707:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782905088:0@lo:400:kworker.0 00000100:00080000:3.0:1788836608.265736:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836608.265753:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836608.265757:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836608.265760:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836608.265976:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782905600 00000100:00100000:1.0:1788836608.265983:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782905600 00000100:00100000:1.0:1788836608.266057:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788836608.266065:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3617:x1875730782905600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836608.266117:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3617:x1875730782905600:12345-0@lo:400:kworker.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.266131:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788836608.266305:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836608.266328:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782905600:0@lo:400:kworker.0 00000100:00100000:0.0:1788836608.266886:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782904576:0@lo:400:kworker.0 00010000:00010000:3.0:1788836608.384040:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836608.638419:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836608.638430:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836608.638474:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788836608.638484:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836608.638865:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782906112:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788836608.640337:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836608.649520:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782906112:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788836608.654199:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.654312:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269312 00000100:00100000:2.0:1788836608.654324:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269312 00000100:00100000:2.0:1788836608.654389:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 232 00000100:00100000:2.0:1788836608.654400:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12485:x1875730770269312:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836608.654603:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836608.654724:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12485:x1875730770269312:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 326us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.654733:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 232 00000100:00100000:3.0:1788836608.660109:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.660185:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269440 00000100:00100000:2.0:1788836608.660197:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269440 00000100:00100000:2.0:1788836608.660276:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00100000:2.0:1788836608.660296:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12485:x1875730770269440:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.660361:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660375:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660383:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660405:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660410:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660414:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660441:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660447:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660450:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836608.660487:0:12185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788836608.660490:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836608.660501:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660509:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660513:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660517:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660528:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.660531:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660537:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660547:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:2.0:1788836608.660549:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836608.660552:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660555:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554f4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660565:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660568:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660572:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660575:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615ca00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.660576:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660579:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660589:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8ade4273b700) 00010000:00010000:2.0:1788836608.660591:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836608.660592:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660596:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554f54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660607:0:12185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660610:0:12185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660613:0:12185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660617:0:12185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.660620:0:12185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660626:0:12185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660633:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.660634:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836608.660637:0:12185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.660642:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.660729:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12485:x1875730770269440:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 434us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.660742:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00100000:3.0:1788836608.666623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.666776:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269696 00000100:00100000:2.0:1788836608.666787:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269696 00000100:00100000:2.0:1788836608.666861:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:2.0:1788836608.666873:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+66:12485:x1875730770269696:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.666894:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.666916:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554f62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa610 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667062:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667087:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667099:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836608.667111:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788836608.667209:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667218:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667224:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667248:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.667252:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667260:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667273:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.667276:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788836608.667758:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667768:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667813:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554f62 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa610 expref: 68 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667835:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:2.0:1788836608.667837:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836608.667842:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554f62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa610 expref: 68 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.667852:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615da00, rc 0) 00000100:00100000:2.0:1788836608.667916:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770269696:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1045us (1304us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788836608.667925:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:0.0:1788836608.678879:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.678968:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770269824 00000100:00100000:1.0:1788836608.678979:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770269824 00000100:00100000:1.0:1788836608.679075:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 235 00000100:00100000:1.0:1788836608.679086:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770269824:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836608.679124:0:10681:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836608.679252:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770269824:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 168us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.679261:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 235 00000100:00100000:3.0:1788836608.685796:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.685881:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270080 00000100:00100000:2.0:1788836608.685907:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270080 00000100:00100000:2.0:1788836608.685970:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:2.0:1788836608.685981:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770270080:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.686008:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.686053:0:12185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788836608.686081:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6554f07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5f4 expref: 67 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686102:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:2.0:1788836608.686107:0:12185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836608.686121:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554f77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa617 expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836608.686510:0:12185:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788836608.686650:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686664:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686675:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686725:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554f77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa617 expref: 69 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686740:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa617 expref: 68 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.686760:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:2.0:1788836608.686762:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836608.686765:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d800, rc 0) 00000100:00100000:2.0:1788836608.686822:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12485:x1875730770270080:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 842us (1036us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788836608.686830:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:3.0:1788836608.691947:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.692041:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270336 00000100:00100000:1.0:1788836608.692053:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270336 00000100:00100000:1.0:1788836608.692210:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:1.0:1788836608.692222:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12485:x1875730770270336:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836608.692280:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836608.692307:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a6554f7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa617 expref: 68 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692327:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b700) 00010000:00010000:1.0:1788836608.692339:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836608.692362:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692377:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692387:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692510:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692518:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692525:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692574:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692580:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692586:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692591:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae6600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.692595:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692601:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692609:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836608.692612:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.692615:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692621:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6554f8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692639:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692645:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692651:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692656:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.692660:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692666:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692674:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdc3eab52 (ffff8ade438f2100) 00010000:00010000:1.0:1788836608.692677:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.692680:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.692685:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7600/0xf7b38383a6554f93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdc3eab52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.692859:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770270336:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 638us (924us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836608.692868:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:0.0:1788836608.695798:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.695881:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270464 00000100:00100000:2.0:1788836608.695892:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270464 00000100:00100000:2.0:1788836608.695959:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:2.0:1788836608.695969:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+67:12485:x1875730770270464:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.695993:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.696047:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa61e expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696095:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696106:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696116:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696243:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554f9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 69 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696262:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 68 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.696279:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:2.0:1788836608.696282:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836608.696286:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615ca00, rc 0) 00000100:00100000:2.0:1788836608.696339:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12485:x1875730770270464:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 371us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.696346:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:3.0:1788836608.698766:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.699059:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270720 00000100:00100000:0.0:1788836608.699074:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270720 00000100:00100000:0.0:1788836608.699132:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:0.0:1788836608.699143:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+68:12485:x1875730770270720:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836608.699237:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.699255:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.699294:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836608.699470:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1788836608.699526:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000590e4a7b reply state 00000000a7f5adbd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.699540:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.699547:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.699550:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788836608.699554:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836608.699705:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+70:12485:x1875730770270720:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 562us (953us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788836608.699713:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:0.0:1788836608.713919:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.714484:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270848 00000100:00100000:2.0:1788836608.714495:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270848 00000100:00100000:2.0:1788836608.714557:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:2.0:1788836608.714567:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+70:12485:x1875730770270848:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.714590:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.714621:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa625 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.714683:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 71 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.714696:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 71 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.714714:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:2.0:1788836608.714717:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836608.714721:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c000, rc 0) 00000100:00100000:2.0:1788836608.715109:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+71:12485:x1875730770270848:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 542us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.715135:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:3.0:1788836608.723084:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.723242:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770270976 00000100:00100000:1.0:1788836608.723252:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770270976 00000100:00100000:1.0:1788836608.723337:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:1.0:1788836608.723369:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2395:x1875730770270976:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788836608.723604:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770270976:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 238us (530us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788836608.723612:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00080000:3.0:1788836608.723860:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836608.727125:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.727226:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770271232 00000100:00100000:0.0:1788836608.727236:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770271232 00000100:00100000:0.0:1788836608.727296:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1788836608.727307:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+71:12485:x1875730770271232:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788836608.727531:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+72:12485:x1875730770271232:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 225us (414us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788836608.727540:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1788836608.736124:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.746847:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770271488 00000100:00100000:2.0:1788836608.746871:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770271488 00000100:00100000:2.0:1788836608.746971:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 241 00000100:00100000:2.0:1788836608.746982:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+72:12485:x1875730770271488:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836608.747134:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+72:12485:x1875730770271488:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 153us (11022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.747142:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 241 00000100:00100000:3.0:1788836608.753543:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.753646:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770271616 00000100:00100000:2.0:1788836608.753657:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770271616 00000100:00100000:2.0:1788836608.753720:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 242 00000100:00100000:2.0:1788836608.753730:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+72:12485:x1875730770271616:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.753883:0:12185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.753905:0:12185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554fb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa62c expref: -99 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.753975:0:12185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.753992:0:12185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.754004:0:12185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836608.754262:0:12185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836608.754286:0:12185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.754312:0:12185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615da00/0xf7b38383a6554fb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa62c expref: 74 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.754330:0:12185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa62c expref: 73 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.754339:0:12185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:3.0:1788836608.754342:0:12185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788836608.754345:0:12185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d200, rc 0) 00000100:00100000:3.0:1788836608.754408:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+73:12485:x1875730770271616:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 679us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836608.754415:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 242 00000100:00100000:0.0:1788836608.760323:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.761209:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770271744 00000100:00100000:2.0:1788836608.761222:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770271744 00000100:00100000:2.0:1788836608.761311:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:2.0:1788836608.761322:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+10:2395:x1875730770271744:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.761344:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.761364:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa633 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836608.761391:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7b00, blocks: 0x0 00010000:00010000:2.0:1788836608.761414:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1788836608.761419:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836608.761430:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.761446:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.761460:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c800, rc 0) 00000100:00100000:2.0:1788836608.761512:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2395:x1875730770271744:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 193us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.761520:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788836608.765122:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.767301:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272000 00000100:00100000:2.0:1788836608.767315:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272000 00000100:00100000:2.0:1788836608.767375:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 243 00000100:00100000:2.0:1788836608.767386:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+73:12485:x1875730770272000:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836608.767497:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+73:12485:x1875730770272000:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 113us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.767504:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 243 00000100:00100000:2.0:1788836608.771590:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836608.771620:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782906240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836608.771704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.771791:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782906240 00000100:00100000:2.0:1788836608.771799:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782906240 00000100:00100000:2.0:1788836608.771841:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836608.771849:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782906240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836608.771873:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788836608.771914:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782906240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.771920:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836608.771973:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782906240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836608.782703:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.782809:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272128 00000100:00100000:1.0:1788836608.782819:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272128 00000100:00100000:1.0:1788836608.782883:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:1.0:1788836608.782893:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:12485:x1875730770272128:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836608.782912:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836608.782930:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa63a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.782963:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.782973:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836608.782977:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836608.782983:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 12 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.783052:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.783076:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.783109:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782906368:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836608.783204:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836608.787254:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782906368:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836608.787293:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 12 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.787315:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7600, rc 0) 00000100:00100000:1.0:1788836608.787376:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:12485:x1875730770272128:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 4484us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.787385:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:0.0:1788836608.788889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.789958:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272256 00000100:00100000:1.0:1788836608.789971:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272256 00010000:00010000:1.0:1788836608.790030:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.790075:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:1.0:1788836608.790085:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+12:2394:x1875730770272256:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836608.790101:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836608.790122:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.790135:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.790182:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c874cea9/0xf7b38383a6554fc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa633 expref: 12 pid: 8408 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.790199:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836608.790204:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836608.790211:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 11 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.790221:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 11 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.790255:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 11 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.790269:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b69c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6476:1875730782906496:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788836608.790361:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836608.801613:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b69c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6476:1875730782906496:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788836608.801645:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836608.801772:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2394:x1875730770272256:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 11686us (12885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.801783:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:2.0:1788836608.803354:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836608.803460:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272384 00000100:00100000:3.0:1788836608.803496:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272384 00002000:00100000:3.0:1788836608.803590:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ade447c9180 x1875730770272384/t0(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:19/0 lens 504/0 e 0 to 0 dl 1788836619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836608.803707:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade447c9180 with x1875730770272384 ext(0->12) 00002000:00010000:3.0:1788836608.803716:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade447c9180 00000100:00100000:3.0:1788836608.803759:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:3.0:1788836608.803774:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+11:2394:x1875730770272384:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788836608.805882:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:2394:x1875730770272384:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 2100us (2586us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788836608.805899:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00002000:00100000:3.0:1788836608.805914:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ade447c9180 x1875730770272384/t4294967321(0) o4->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:19/0 lens 504/448 e 0 to 0 dl 1788836619 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836608.805926:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade447c9180 with x1875730770272384 ext(0->12) 00002000:00010000:3.0:1788836608.805933:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade447c9180 00000100:00100000:0.0:1788836608.807910:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.808521:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272512 00000100:00100000:2.0:1788836608.808537:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272512 00000100:00100000:2.0:1788836608.808680:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 244 00000100:00100000:2.0:1788836608.808692:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+73:12485:x1875730770272512:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788836608.816857:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788836608.816895:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788836608.816943:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788836608.816969:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ade4293f180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788836608.816974:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf51a30400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ade4293f0c0 00000020:00080000:3.0:1788836608.816978:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf51a30000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade43a3a400 00000020:00080000:3.0:1788836608.817071:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ade4293ff00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788836608.817075:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf51a30600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adf442f8900 00000020:00080000:3.0:1788836608.817077:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf51a30d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adf43e3b600 00000020:00080000:3.0:1788836608.817088:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788836608.817125:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788836608.817219:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1788836608.817311:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817325:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817342:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817350:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817358:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817368:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817391:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adf439d0d00) 00010000:00010000:1.0:1788836608.817394:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.817400:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817406:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6554cd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817440:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817447:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817453:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817458:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817461:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817477:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817486:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adf4b4fbc00) 00010000:00010000:1.0:1788836608.817488:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.817492:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817497:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7800/0xf7b38383a6554d78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817516:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817523:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817528:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817534:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817537:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817543:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817550:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:1.0:1788836608.817552:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.817555:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817566:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6554df6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817582:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817587:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817594:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817599:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817602:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817608:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817615:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade438f2000) 00010000:00010000:1.0:1788836608.817618:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.817620:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817626:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6554e19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817641:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817647:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817657:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817662:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817665:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817672:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817680:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836608.817683:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836608.817686:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817691:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a6554eeb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817704:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817711:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817716:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817721:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836608.817724:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817742:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817751:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:1.0:1788836608.817754:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788836608.817758:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.817763:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.817789:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836608.817812:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782906624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836608.817887:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836608.817967:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782906624 00000100:00100000:0.0:1788836608.817981:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782906624 00000100:00100000:2.0:1788836608.818236:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12485:x1875730770272512:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 9543us (10339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.818247:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 244 00000100:00100000:1.0:1788836608.818782:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836608.818798:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782906752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788836608.818834:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836608.819065:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782906752 00000100:00100000:2.0:1788836608.819075:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782906752 00000100:00100000:2.0:1788836608.819125:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788836608.819135:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3615:x1875730782906752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788836608.819161:0:8498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1788836608.819204:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7aff, atime: 0x6a9f7aff, ctime: 0x6a9f7aff, blocks: 0x8 00010000:00010000:2.0:1788836608.819222:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.819239:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1788836608.819245:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836608.819253:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.819268:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.819289:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.819297:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.819316:0:8498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836608.819463:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3615:x1875730782906752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (626us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788836608.819470:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1788836608.819570:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade447c9c00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788836608.819586:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782906752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788836608.819825:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836608.819834:0:10309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.819842:0:10309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836608.819847:0:10309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.819856:0:10309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.819888:0:10309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.819896:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dbe03d/0xf7b38383a6554fd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.819922:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836608.819924:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836608.819926:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836608.820329:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836608.820483:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272640 00000100:00100000:1.0:1788836608.820490:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272640 00000100:00100000:1.0:1788836608.820532:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788836608.820541:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+13:2395:x1875730770272640:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788836608.822428:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836608.822455:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782906624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788836608.822499:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788836608.822531:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.822573:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.822585:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788836608.822590:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836608.822602:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.822649:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.822667:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 13 pid: 8408 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.822684:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1875730782906880:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836608.822803:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be840 going to sleep for 11 seconds 00000001:00080000:1.0:1788836608.828436:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788836608.828482:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:0.0:1788836608.828610:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8408:1875730782906880:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836608.828651:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.828900:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770272640:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 8350us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.828918:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1788836608.829950:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.830059:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770272768 00000100:00100000:0.0:1788836608.830074:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770272768 00010000:00010000:0.0:1788836608.830131:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.830187:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1788836608.830198:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770272768:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836608.830218:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836608.830225:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.830251:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.830292:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e106c795/0xf7b38383a6554d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa592 expref: 8 pid: 8408 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.830313:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836608.830319:0:13174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836608.830325:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.830337:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.830389:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836608.832192:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770272768:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1974us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836608.832206:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00010000:00010000:1.0:1788836608.839303:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.839326:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.839340:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.839348:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.839389:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836608.840586:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788836608.840594:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788836608.842885:0:3616:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ade42a5c380 x1875730782906624/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788836624 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788836608.842919:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade42a5c380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788836608.842945:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782906624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836608.843625:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782906624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17951us (22506us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788836608.843638:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1788836608.845008:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836608.845131:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.845144:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836608.845148:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.845160:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.845193:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.845202:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc10164/0xf7b38383a6554fd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.845226:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836608.845228:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836608.845230:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836608.845467:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.845706:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273024 00000100:00100000:0.0:1788836608.845716:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273024 00000100:00100000:0.0:1788836608.845775:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 245 00000100:00100000:0.0:1788836608.845786:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12485:x1875730770273024:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836608.845841:0:10333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836608.845864:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d200/0xf7b38383a6554fbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa62c expref: 21 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.845880:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.845884:0:10333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836608.845916:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.845929:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.845938:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836608.846091:0:10333:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078855edd reply state 000000004c8146ef transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.846102:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.846123:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.846125:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836608.846128:0:10333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836608.846243:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:12485:x1875730770273024:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 458us (779us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788836608.846250:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 245 00000100:00100000:1.0:1788836608.854082:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836608.854163:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273152 00000100:00100000:3.0:1788836608.854196:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273152 00000100:00100000:3.0:1788836608.854256:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:3.0:1788836608.854265:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770273152:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788836608.854432:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788836608.854436:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788836607 00002000:00010000:3.0:1788836608.854438:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788836607 00002000:00010000:3.0:1788836608.854440:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788836608 -> 1788836607 00002000:00010000:3.0:1788836608.854441:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788836608.854498:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2395:x1875730770273152:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 232us (426us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788836608.854505:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:1.0:1788836608.857663:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.857789:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273408 00000100:00100000:2.0:1788836608.857799:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273408 00000100:00100000:2.0:1788836608.857861:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 246 00000100:00100000:2.0:1788836608.857871:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:12485:x1875730770273408:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.857934:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.857950:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.857959:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.857990:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.858003:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 22 pid: 10681 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.858052:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782907008:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836608.858121:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836608.859829:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1875730782907008:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.859862:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836608.860696:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.860873:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273536 00000100:00100000:0.0:1788836608.860882:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273536 00010000:00010000:0.0:1788836608.860918:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 23 pid: 10681 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.860957:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1788836608.860967:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+23:2395:x1875730770273536:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836608.860980:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836608.860987:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 23 pid: 10681 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.860999:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 23 pid: 10681 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.861060:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6554fa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa61e expref: 23 pid: 10681 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.861078:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.861083:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.861110:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.861118:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.861139:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836608.861200:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2395:x1875730770273536:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 234us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836608.861208:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00010000:00010000:2.0:1788836608.861286:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861294:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861339:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861346:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861353:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861358:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615dc00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836608.861363:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861370:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861380:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:2.0:1788836608.861383:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788836608.861386:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.861391:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6554fe7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.861447:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12485:x1875730770273408:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 3577us (3793us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788836608.861461:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 246 00000100:00100000:0.0:1788836608.865605:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.865714:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273664 00000100:00100000:2.0:1788836608.865724:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273664 00000100:00100000:2.0:1788836608.865773:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:2.0:1788836608.865783:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770273664:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788836608.865825:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.865847:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.865855:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836608.865859:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836608.865863:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.865898:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.865912:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 8 pid: 8405 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.865925:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782907136:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836608.866035:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836608.868561:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8405:1875730782907136:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.868622:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.868902:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.869178:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770273792 00000100:00100000:2.0:1788836608.869186:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770273792 00010000:00010000:2.0:1788836608.869218:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 9 pid: 8405 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.869258:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:2.0:1788836608.869267:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+9:2394:x1875730770273792:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836608.869353:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836608.869375:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 9 pid: 8405 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.869387:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 9 pid: 8405 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.869485:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002271550b/0xf7b38383a6554fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa63a expref: 9 pid: 8405 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.869501:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836608.869505:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836608.869511:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.869520:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.870425:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836608.870490:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2394:x1875730770273792:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1221us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.870500:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00010000:00010000:1.0:1788836608.873493:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.873512:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.873544:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.873553:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.873561:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.873568:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836608.873574:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.874150:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.874180:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836608.874188:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193b11a4/0xf7b38383a6554fee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.877501:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770273664:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 11704us (11897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.877518:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:0.0:1788836608.880639:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836608.880766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274048 00000100:00100000:3.0:1788836608.880776:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274048 00000100:00100000:3.0:1788836608.880841:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 247 00000100:00100000:3.0:1788836608.880852:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:12485:x1875730770274048:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836608.880930:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.880946:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 21 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.880955:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.880987:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 21 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.881000:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 21 pid: 12185 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836608.881066:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907264:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836608.881133:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836608.885483:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907264:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.885517:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836608.885750:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.889495:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274176 00000100:00100000:0.0:1788836608.889513:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274176 00010000:00010000:2.0:1788836608.898244:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 22 pid: 12185 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.898307:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:2.0:1788836608.898317:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2394:x1875730770274176:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836608.898333:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836608.898338:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 22 pid: 12185 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898350:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 22 pid: 12185 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898370:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82044a00/0xf7b38383a6554ee4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa5e6 expref: 22 pid: 12185 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898588:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836608.898595:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898606:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898612:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898620:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.898656:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836608.898724:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:2394:x1875730770274176:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 408us (12973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.898731:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00010000:00010000:3.0:1788836608.899512:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899521:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899711:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899726:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899734:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899771:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.899785:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 21 pid: 6490 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836608.899798:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907392:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836608.899870:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836608.902386:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.902616:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907392:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836608.902643:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.902828:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274304 00000100:00100000:0.0:1788836608.902835:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274304 00010000:00010000:0.0:1788836608.902870:0:13174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 22 pid: 6490 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.902907:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:0.0:1788836608.902915:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2395:x1875730770274304:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836608.902930:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836608.902936:0:13174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 22 pid: 6490 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.902947:0:13174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 22 pid: 6490 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.902977:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6554faf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa625 expref: 22 pid: 6490 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.902994:0:13174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.902999:0:13174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.903008:0:13174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.903116:0:13174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.904378:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836608.904520:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:2395:x1875730770274304:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1600us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836608.904531:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00010000:00010000:3.0:1788836608.911366:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.911385:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836608.911504:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788836608.911640:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788836608.911676:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788836608.911763:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782907520:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788836608.911835:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836608.911874:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836608.912198:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782907520 00000100:00100000:2.0:1788836608.912207:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782907520 00000100:00100000:2.0:1788836608.912267:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788836608.912285:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6491:x1875730782907520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836608.912377:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6491:x1875730782907520:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836608.912401:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788836608.912585:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782907520:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788836608.912721:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788836608.912771:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782907648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788836608.912823:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836608.912836:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836608.912925:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782907648 00000100:00100000:1.0:1788836608.912930:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782907648 00000100:00100000:1.0:1788836608.912962:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788836608.912970:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf48b14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1875730782907648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836608.913097:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf48b14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6491:x1875730782907648:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (273us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788836608.913104:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788836608.913616:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6491:1875730782907648:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788836608.913653:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913662:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913670:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913675:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836608.913679:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913695:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913711:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836608.913713:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836608.913718:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913724:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701a00/0xf7b38383a6554ffc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913749:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913755:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913760:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913764:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615cc00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836608.913767:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913772:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913779:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836608.913780:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836608.913787:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913808:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913816:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.913844:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836608.913856:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907776:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788836608.913930:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836608.919218:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1875730782907776:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788836608.919252:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919264:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a6554f3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919308:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919323:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919335:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919345:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919364:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919370:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919375:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836608.919380:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919386:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919397:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836608.919400:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836608.919404:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919410:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992a00/0xf7b38383a6555003 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919420:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919425:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919430:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919434:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836608.919443:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919449:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919457:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836608.919459:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836608.919462:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836608.919467:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700400/0xf7b38383a6554ff5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836608.919819:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836608.919825:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836608.920354:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788836608.920363:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836608.920662:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12485:x1875730770274048:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 39808us (40031us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788836608.920675:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 247 00000020:00080000:0.0:1788836608.920682:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788836608.928789:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.929668:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274432 00000100:00100000:0.0:1788836608.929680:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274432 00000100:00100000:1.0:1788836608.930048:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:1.0:1788836608.930061:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12484:x1875730770274432:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:1.0:1788836608.930202:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12484:x1875730770274432:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 144us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836608.930210:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1788836608.938580:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.938750:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274688 00000100:00100000:2.0:1788836608.938762:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274688 00000100:00100000:2.0:1788836608.938833:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788836608.938845:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+24:12485:x1875730770274688:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836608.939215:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836608.939253:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788836608.939288:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939305:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939316:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939324:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939331:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939337:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.939361:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836608.939459:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:12485:x1875730770274688:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 616us (893us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788836608.939466:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000020:00080000:2.0:1788836608.939472:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836608.939989:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836608.939997:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.940005:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836608.940038:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.940048:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.940071:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:3.0:1788836608.940080:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836608.940086:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.940093:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a655500a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836608.940106:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836608.940108:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836608.940110:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836608.946136:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836608.946248:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770274944 00000100:00100000:0.0:1788836608.946259:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770274944 00000100:00100000:0.0:1788836608.946322:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:0.0:1788836608.946332:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:12484:x1875730770274944:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:0.0:1788836608.946509:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788836608.946593:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:12484:x1875730770274944:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 262us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836608.946708:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:0.0:1788836608.995496:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836608.995602:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275072 00000100:00100000:2.0:1788836608.995612:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275072 00000100:00100000:2.0:1788836608.995679:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 249 00000100:00100000:2.0:1788836608.995690:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+26:12487:x1875730770275072:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836608.995719:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836608.995755:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a6555011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa641 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995825:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995841:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995854:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995869:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995878:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995885:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995970:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.995994:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.996002:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.996077:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836608.996091:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 27 pid: 6492 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836608.996105:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782907904:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836608.996203:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade4293f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836609.009643:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836609.009721:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275328 00000100:00100000:3.0:1788836609.009731:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275328 00000100:00100000:3.0:1788836609.009801:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:3.0:1788836609.009810:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:6169:x1875730770275328:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788836609.009998:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:6169:x1875730770275328:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 188us (365us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788836609.010005:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00080000:2.0:1788836609.010281:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836609.010363:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1875730782907904:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788836609.010411:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836609.012140:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836609.012222:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275456 00000100:00100000:1.0:1788836609.012232:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275456 00010000:00010000:1.0:1788836609.012282:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 29 pid: 6492 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836609.012323:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:1.0:1788836609.012334:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:2394:x1875730770275456:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836609.012349:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836609.012356:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 29 pid: 6492 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012369:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 29 pid: 6492 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012391:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ce00/0xf7b38383a6554f31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa602 expref: 29 pid: 6492 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012409:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836609.012414:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012423:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012431:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836609.012463:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836609.012517:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:2394:x1875730770275456:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836609.012525:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00010000:00010000:0.0:1788836609.012644:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012652:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836609.012699:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788836609.012703:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836609.012722:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012748:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012758:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012766:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012773:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012778:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836609.012782:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012789:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012813:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:0.0:1788836609.012816:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836609.012820:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012826:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012838:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012844:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012849:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012853:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615cc00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836609.012856:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012861:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012868:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ade4273b400) 00010000:00010000:0.0:1788836609.012870:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836609.012872:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012877:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615cc00/0xf7b38383a655501f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012920:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d400/0xf7b38383a6555011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa641 expref: 28 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012934:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa641 expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836609.012942:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:0.0:1788836609.012944:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836609.012947:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615dc00, rc 0) 00000100:00100000:0.0:1788836609.012991:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12487:x1875730770275072:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 17303us (17508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836609.012998:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 249 00000001:00080000:2.0:1788836609.094490:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788836609.094516:0:8401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1788836609.413734:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836609.866999:0:14748:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836609.867009:0:14748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836609.867063:0:14748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788836609.867069:0:14748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788836609.986439:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836609.986448:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836609.986469:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788836609.986475:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836609.987686:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782908032:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836609.987805:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836610.005798:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836610.005887:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275584 00000100:00100000:3.0:1788836610.005897:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275584 00000100:00100000:0.0:1788836610.005940:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13783:1875730782908032:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836610.005966:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:3.0:1788836610.005975:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12499:x1875730770275584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836610.006008:0:10681:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836610.006169:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12499:x1875730770275584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 195us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836610.006178:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:1.0:1788836610.024734:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836610.027499:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275840 00000100:00100000:2.0:1788836610.027515:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275840 00000100:00100000:2.0:1788836610.027624:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:2.0:1788836610.027636:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+27:12499:x1875730770275840:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836610.027674:0:10333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836610.027695:0:10333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d600/0xf7b38383a655502d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa648 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836610.027800:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6555034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836610.027815:0:10333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6555034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836610.027826:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6555034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836610.027836:0:10333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788836610.027959:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d600/0xf7b38383a655502d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa648 expref: 30 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836610.027977:0:10333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6555034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa648 expref: 29 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836610.027985:0:10333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:2.0:1788836610.027988:0:10333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836610.027991:0:10333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615ca00, rc 0) 00000100:00100000:2.0:1788836610.028099:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:12499:x1875730770275840:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 465us (3373us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788836610.028107:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:0.0:1788836610.033939:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836610.034174:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770275968 00000100:00100000:3.0:1788836610.034197:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770275968 00000100:00100000:3.0:1788836610.034254:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1788836610.034265:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:2396:x1875730770275968:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836610.034283:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836610.034312:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a6555034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa648 expref: 29 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.034335:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836610.034339:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836610.034397:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:2396:x1875730770275968:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 133us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836610.034404:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1788836610.034888:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836610.034960:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276224 00000100:00100000:3.0:1788836610.034965:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276224 00000100:00100000:3.0:1788836610.034995:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 252 00000100:00100000:3.0:1788836610.035003:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+28:12499:x1875730770276224:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836610.035624:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035642:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035654:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035857:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035874:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035881:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035886:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836610.035890:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035897:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035906:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836610.035909:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836610.035914:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836610.035919:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a6555042 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836610.036028:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:12499:x1875730770276224:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 1009us (1125us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788836610.036037:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 252 00000040:00080000:3.0:1788836610.039708:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836610.039719:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836610.039738:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788836610.039745:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836610.042746:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836610.043508:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276480 00000100:00100000:2.0:1788836610.043519:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276480 00000100:00100000:2.0:1788836610.043590:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1788836610.043608:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+29:12499:x1875730770276480:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836610.043832:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:12499:x1875730770276480:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 227us (1094us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788836610.043840:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00010000:00010000:3.0:1788836610.430538:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836610.816625:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836610.816650:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782908160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836610.816724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836610.816895:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908160 00000100:00100000:0.0:1788836610.816903:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908160 00000100:00100000:0.0:1788836610.816960:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788836610.816970:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782908160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836610.817007:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836610.817105:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782908160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836610.817130:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788836610.817258:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782908160:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788836610.878979:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788836611.459273:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836611.860133:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782908288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836611.860207:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.860449:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908288 00000100:00100000:1.0:1788836611.860457:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908288 00000100:00100000:1.0:1788836611.860513:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788836611.860522:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782908288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836611.860568:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836611.860615:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782908288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836611.860623:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788836611.860645:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836611.860684:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782908288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836611.865310:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836611.865343:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782908416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836611.865417:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.865475:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908416 00000100:00100000:1.0:1788836611.865484:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908416 00000100:00100000:1.0:1788836611.865536:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788836611.865546:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782908416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836611.865579:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836611.865624:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782908416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836611.865631:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1788836611.865653:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836611.865683:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788836611.865689:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1788836611.865720:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adf7fc9b480, transno 4294967308 00000004:00080000:1.0:1788836611.865732:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788836611.865742:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade447c9c00, transno 4294967311 00000100:00100000:1.0:1788836611.865755:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782908416:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788836612.007947:0:14799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836612.007955:0:14799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836612.007988:0:14799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788836612.007995:0:14799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836612.048555:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048604:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048631:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048650:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048670:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048689:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048727:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.048762:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276864 00000100:00100000:0.0:1788836612.048772:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276864 00000100:00100000:0.0:1788836612.048829:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277376 00000100:00100000:0.0:1788836612.048833:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277376 00000100:00100000:0.0:1788836612.048854:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276736 00000100:00100000:0.0:1788836612.048856:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276736 00000100:00100000:0.0:1788836612.048880:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277248 00000100:00100000:0.0:1788836612.048883:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277248 00000100:00100000:0.0:1788836612.048899:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 355 00000100:00100000:0.0:1788836612.048909:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770276864:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.048995:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770276864:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 86us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049003:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 355 00000100:00100000:0.0:1788836612.049041:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 356 00000100:00100000:0.0:1788836612.049049:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770277376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.049074:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770277376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049080:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 356 00000100:00100000:0.0:1788836612.049100:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 357 00000100:00100000:0.0:1788836612.049106:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:2394:x1875730770276736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.049146:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:2394:x1875730770276736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049152:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 357 00000100:00100000:0.0:1788836612.049167:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 358 00000100:00100000:0.0:1788836612.049173:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770277248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.049195:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2394:x1875730770277248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049200:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 358 00000100:00100000:0.0:1788836612.049220:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277120 00000100:00100000:0.0:1788836612.049224:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277120 00000100:00100000:0.0:1788836612.049247:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276992 00000100:00100000:0.0:1788836612.049250:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276992 00000100:00100000:0.0:1788836612.049270:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1788836612.049276:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770277120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.049301:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2394:x1875730770277120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049308:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1788836612.049319:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:0.0:1788836612.049325:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770276992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836612.049348:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770276992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.049353:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:1.0:1788836612.052809:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770276608 00000100:00100000:1.0:1788836612.052829:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770276608 00000100:00100000:1.0:1788836612.052903:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 397 00000100:00100000:1.0:1788836612.052915:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770276608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836612.052987:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770276608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 74us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836612.052994:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 397 00000100:00080000:1.0:1788836612.053054:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836612.053059:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836612.053063:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836612.053065:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836612.271963:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836612.272337:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277632 00000100:00100000:1.0:1788836612.272346:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277632 00000100:00100000:1.0:1788836612.272398:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:1.0:1788836612.272407:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+30:12519:x1875730770277632:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836612.272428:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836612.272448:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6555049 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa64f expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.272581:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6555050 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.272597:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6555050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.272619:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6555050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836612.272631:0:10681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788836612.272744:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae7000/0xf7b38383a6555049 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa64f expref: 33 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.272761:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6555050 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa64f expref: 32 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.272770:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836612.272772:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788836612.272776:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6600, rc 0) 00000100:00100000:1.0:1788836612.272838:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:12519:x1875730770277632:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 432us (888us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788836612.272856:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:1.0:1788836612.281445:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836612.282427:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277760 00000100:00100000:3.0:1788836612.282442:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277760 00000100:00100000:3.0:1788836612.282505:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:3.0:1788836612.282513:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:12519:x1875730770277760:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788836612.282724:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282746:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282760:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282803:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282809:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282816:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282822:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836612.282826:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282835:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282847:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:3.0:1788836612.282850:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836612.282855:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.282869:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a701800/0xf7b38383a655505e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836612.282944:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+32:12519:x1875730770277760:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 431us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836612.282953:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:1.0:1788836612.445366:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836612.446646:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770277888 00000100:00100000:3.0:1788836612.446663:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770277888 00000100:00100000:3.0:1788836612.446735:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1788836612.446747:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2396:x1875730770277888:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1788836612.446768:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836612.446789:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003861f538/0xf7b38383a6555065 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa656 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836612.446820:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f7aff, atime: 0x6a9f7aff, ctime: 0x6a9f7aff, blocks: 0x8 00010000:00010000:3.0:1788836612.446841:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1788836612.446846:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836612.446856:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003861f538/0xf7b38383a6555065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa656 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.446878:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003861f538/0xf7b38383a6555065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa656 expref: 8 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.446890:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701800, rc 0) 00000100:00100000:3.0:1788836612.446970:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2396:x1875730770277888:12345-192.168.201.38@tcp:101:cat.0 Request processed in 225us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836612.446994:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1788836612.455979:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836612.456169:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278016 00000100:00100000:0.0:1788836612.456181:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278016 00002000:00100000:0.0:1788836612.456259:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ade43b68a80 x1875730770278016/t0(0) o3->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:23/0 lens 488/0 e 0 to 0 dl 1788836623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836612.456271:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade43b68a80 with x1875730770278016 ext(0->4095) 00002000:00010000:0.0:1788836612.456277:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade43b68a80 00000100:00100000:0.0:1788836612.456310:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788836612.456320:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2397:x1875730770278016:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:0.0:1788836612.456606:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+8:2397:x1875730770278016:12345-192.168.201.38@tcp:3:cat.0 Request processed in 285us (638us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788836612.456615:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00002000:00100000:0.0:1788836612.456622:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ade43b68a80 x1875730770278016/t0(0) o3->9b8fbf20-a55f-40bb-87b6-19e878cca24b@192.168.201.38@tcp:23/0 lens 488/4536 e 0 to 0 dl 1788836623 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836612.456629:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ade43b68a80 with x1875730770278016 ext(0->4095) 00002000:00010000:0.0:1788836612.456633:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ade43b68a80 00010000:00010000:1.0:1788836612.479498:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836612.862712:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782908544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836612.862807:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.863071:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908544 00000100:00100000:0.0:1788836612.863081:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908544 00000100:00100000:0.0:1788836612.863155:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788836612.863167:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782908544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836612.863315:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788836612.863377:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782908544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 212us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.863384:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788836612.863473:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782908544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836613.376281:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782909056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376370:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376437:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782909568:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376466:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376482:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782910080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376502:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376534:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788836613.376540:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782908672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376569:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376592:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782909184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376634:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782909696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376653:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376667:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376685:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376710:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782908800:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376730:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376743:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782909312:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376776:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782909824:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376794:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376813:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836613.376832:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782908928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376853:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376872:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782909440:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376892:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376907:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782909952:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.376926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836613.376959:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909056 00000100:00100000:3.0:1788836613.376967:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909056 00000100:00100000:3.0:1788836613.377066:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908800 00000100:00100000:3.0:1788836613.377070:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908800 00000100:00100000:2.0:1788836613.377083:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909568 00000100:00100000:3.0:1788836613.377086:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909312 00000100:00100000:3.0:1788836613.377102:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909312 00000100:00100000:2.0:1788836613.377102:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909568 00000100:00100000:0.0:1788836613.377187:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909824 00000100:00100000:0.0:1788836613.377193:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909824 00000100:00100000:3.0:1788836613.377223:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909440 00000100:00100000:3.0:1788836613.377228:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909440 00000100:00100000:1.0:1788836613.378100:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909952 00000100:00100000:1.0:1788836613.378109:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909952 00000100:00100000:2.0:1788836613.378773:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910080 00000100:00100000:2.0:1788836613.378781:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910080 00000100:00100000:2.0:1788836613.378797:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909696 00000100:00100000:2.0:1788836613.378801:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909696 00000100:00100000:2.0:1788836613.378817:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910208 00000100:00100000:2.0:1788836613.378820:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910208 00000100:00100000:2.0:1788836613.378840:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836613.378852:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782909568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.378960:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782909568:12345-0@lo:400:kworker.0 Request processed in 110us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.378969:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836613.378991:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836613.378998:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782910080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.379043:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782910080:12345-0@lo:400:kworker.0 Request processed in 45us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.379069:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836613.379084:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788836613.379101:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782909696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.379137:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782909696:12345-0@lo:400:kworker.0 Request processed in 48us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.379143:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788836613.379158:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788836613.379165:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782910208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.379191:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782910208:12345-0@lo:400:kworker.0 Request processed in 27us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.379197:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788836613.379227:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782909184 00000100:00100000:2.0:1788836613.379232:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782909184 00000100:00100000:2.0:1788836613.380487:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908928 00000100:00100000:2.0:1788836613.380500:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908928 00000100:00100000:2.0:1788836613.380519:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788836613.380527:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782909184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.381035:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788836613.381063:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782909056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.381103:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788836613.381115:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.381154:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782909184:12345-0@lo:400:kworker.0 Request processed in 627us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.381163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788836613.381180:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788836613.381187:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782908928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836613.384609:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788836613.384624:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782909312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.384772:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782909056:12345-0@lo:400:kworker.0 Request processed in 3709us (8399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.384782:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788836613.384813:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788836613.384821:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.384872:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782909824:12345-0@lo:400:kworker.0 Request processed in 54us (8076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.384879:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788836613.384894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788836613.384901:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782909440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.384928:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782909440:12345-0@lo:400:kworker.0 Request processed in 28us (8036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.384934:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788836613.384949:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788836613.384955:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782909952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.384980:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782909952:12345-0@lo:400:kworker.0 Request processed in 26us (8053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.384986:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000004:00080000:0.0:1788836613.385079:0:10026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397291066784ns, next at 398291064153ns, rc = 0 00000100:00100000:0.0:1788836613.385111:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836613.385125:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782910336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836613.385162:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836613.385198:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910336 00000100:00100000:0.0:1788836613.385205:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910336 00000100:00100000:0.0:1788836613.385261:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788836613.385268:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782910336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836613.385290:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788836613.385327:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875730782910336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.385333:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788836613.385390:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782910336:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788836613.385424:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d9c00 x1875730782909440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836613.385434:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782909440:0@lo:400:kworker.0 00010000:00080000:0.0:1788836613.385445:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d8e00 x1875730782909952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836613.385453:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782909952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.385465:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782909824:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.385619:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782908672 00000100:00100000:0.0:1788836613.385624:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782908672 00000100:00100000:0.0:1788836613.385653:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788836613.385659:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782908672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.385693:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782908672:12345-0@lo:400:kworker.0 Request processed in 34us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836613.385699:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:0.0:1788836613.387472:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836613.387482:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836613.387485:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836613.387494:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836613.387542:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782908672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387559:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782909184:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387571:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782909696:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387583:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910208:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387595:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782909056:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387607:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782909568:0@lo:400:kworker.0 00000100:00100000:0.0:1788836613.387618:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782910080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.388888:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782908800:12345-0@lo:400:kworker.0 Request processed in 7768us (12147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836613.388904:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788836613.388964:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782908800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836613.394082:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782908928:12345-0@lo:400:kworker.0 Request processed in 12883us (17215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.394110:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788836613.398587:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782909312:12345-0@lo:400:kworker.0 Request processed in 13953us (21812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836613.398605:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788836613.398776:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782908928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836613.398793:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782909312:0@lo:400:kworker.0 00010000:00010000:3.0:1788836613.502196:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836613.890501:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782910464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836613.890616:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836613.890974:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910464 00000100:00100000:2.0:1788836613.890984:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910464 00000100:00100000:2.0:1788836613.891094:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836613.891108:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782910464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836613.891142:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788836613.891203:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782910464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.891210:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788836613.891313:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782910464:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836614.528969:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788836614.915136:0:6468:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788836614.915194:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788836614.915255:0:6468:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ade42ad0300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788836614.915262:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf46e4c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ade42ad0c00 00000020:00080000:3.0:1788836614.915266:0:6468:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adf46e4c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ade43934000 00000020:00080000:3.0:1788836614.915289:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1788836614.915358:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836614.915435:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836614.915551:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910592 00000100:00100000:3.0:1788836614.915560:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910592 00000100:00100000:3.0:1788836614.915607:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788836614.915616:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782910592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788836614.915755:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788836614.915759:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788836607 -> 1788836607 00002000:00010000:3.0:1788836614.915761:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788836607 -> 1788836607 00002000:00010000:3.0:1788836614.915764:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788836607 -> 1788836607 00002000:00010000:3.0:1788836614.915766:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788836614.915806:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3614:x1875730782910592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (371us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788836614.915814:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:3.0:1788836614.915858:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade447c9880/2, rc 0, transno 4294967325 00000100:00100000:3.0:1788836614.915864:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910592:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788836614.915986:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916009:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916106:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916114:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836614.916120:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916128:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916169:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ade4273b200) 00010000:00010000:0.0:1788836614.916172:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836614.916177:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836614.916184:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993400/0xf7b38383a6554fe0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10333 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788836614.916295:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788836614.916358:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788836614.917357:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788836614.917369:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1788836615.551534:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836615.936133:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836615.936168:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836615.936268:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836615.936416:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910720 00000100:00100000:0.0:1788836615.936436:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910720 00000100:00100000:0.0:1788836615.936505:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788836615.936517:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782910720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836615.936566:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836615.936631:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782910720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836615.936639:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788836615.936700:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782910720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788836616.574332:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836616.958689:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782910976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836616.959816:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836616.959961:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782910848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836616.961260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836616.962787:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910976 00000100:00100000:2.0:1788836616.962809:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910976 00000100:00080000:0.0:1788836616.963466:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836616.963616:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782910848 00000100:00100000:2.0:1788836616.963622:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782910848 00000100:00100000:2.0:1788836616.963677:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836616.963690:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782910976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836616.963746:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836616.963853:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782910976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836616.963861:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788836616.964000:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836616.964184:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836616.964197:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782910848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836616.964211:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836616.964248:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782910848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836616.964255:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788836616.964634:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade447cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782910848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836616.964868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782910976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836617.167326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836617.167746:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278144 00000100:00100000:1.0:1788836617.167760:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278144 00000100:00100000:1.0:1788836617.167863:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 399 00000100:00100000:1.0:1788836617.167876:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770278144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836617.167990:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2395:x1875730770278144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 116us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836617.167998:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 399 00000100:00100000:2.0:1788836617.174982:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836617.175068:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836617.175109:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836617.175167:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836617.175189:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836617.177770:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278272 00000100:00100000:0.0:1788836617.177792:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278272 00000100:00100000:0.0:1788836617.177887:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278400 00000100:00100000:0.0:1788836617.177891:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278400 00000100:00100000:0.0:1788836617.177908:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278912 00000100:00100000:0.0:1788836617.177911:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278912 00000100:00100000:0.0:1788836617.177949:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 365 00000100:00100000:0.0:1788836617.177981:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770278272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836617.178159:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2395:x1875730770278272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 179us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836617.178167:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 365 00000100:00100000:0.0:1788836617.178192:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 366 00000100:00100000:0.0:1788836617.178199:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770278400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836617.178240:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770278400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836617.178246:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 366 00000100:00100000:0.0:1788836617.178258:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 367 00000100:00100000:0.0:1788836617.178263:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770278912:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836617.178287:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770278912:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836617.178292:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 367 00000100:00100000:0.0:1788836617.178321:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278656 00000100:00100000:0.0:1788836617.178325:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278656 00000100:00100000:0.0:1788836617.178552:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278528 00000100:00100000:0.0:1788836617.178557:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278528 00000100:00100000:0.0:1788836617.178582:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:0.0:1788836617.178590:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770278656:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836617.178624:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770278656:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (3514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836617.178630:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:0.0:1788836617.178642:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:0.0:1788836617.178657:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade447c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770278528:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836617.178685:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade447c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2395:x1875730770278528:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836617.178692:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:2.0:1788836617.179052:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836617.179323:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770278784 00000100:00100000:3.0:1788836617.179329:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770278784 00000100:00100000:3.0:1788836617.179385:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 368 00000100:00100000:3.0:1788836617.179400:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770278784:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836617.179452:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770278784:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836617.179459:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 368 00000100:00080000:3.0:1788836617.179493:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836617.179496:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836617.179499:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836617.179502:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836617.599111:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836617.982837:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782911104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836617.982954:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836617.984616:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911104 00000100:00100000:2.0:1788836617.984634:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911104 00000100:00100000:2.0:1788836617.984715:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788836617.984728:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782911104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836617.984780:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788836617.985691:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782911104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 959us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836617.985705:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788836617.985851:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782911104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836618.496421:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782911232:0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.496487:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782911616:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.496516:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836618.496616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836618.496684:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782912128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.496714:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836618.496735:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782912640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.496758:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836618.496804:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912128 00000100:00100000:3.0:1788836618.496815:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912128 00000100:00100000:3.0:1788836618.496964:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912640 00000100:00100000:3.0:1788836618.496968:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912640 00000100:00100000:3.0:1788836618.496994:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788836618.497047:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.497111:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782912128:12345-0@lo:400:kworker.0 Request processed in 108us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836618.497119:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788836618.497148:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788836618.497154:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.497206:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782912640:12345-0@lo:400:kworker.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836618.497212:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1788836618.497241:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836618.497246:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836618.497292:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782912128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.497305:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782912640:0@lo:400:kworker.0 00000100:00100000:3.0:1788836618.497353:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911232 00000100:00100000:3.0:1788836618.497357:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911232 00000100:00100000:3.0:1788836618.497382:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788836618.497388:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782911232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497590:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782911488:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497633:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836618.497663:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782912000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497689:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836618.497718:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782912512:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836618.497761:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788836618.497769:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782911360:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497790:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836618.497807:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782911872:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.497828:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836618.498701:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782911232:12345-0@lo:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836618.498720:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788836618.498791:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782912384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.501847:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782911232:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.501869:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782911744:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502044:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836618.502090:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782912256:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502119:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836618.502142:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782912768:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502168:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836618.502250:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911616 00000100:00100000:0.0:1788836618.502258:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911616 00000100:00100000:0.0:1788836618.502316:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912000 00000100:00100000:0.0:1788836618.502320:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912000 00000100:00100000:0.0:1788836618.502346:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912512 00000100:00100000:0.0:1788836618.502350:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912512 00000100:00100000:0.0:1788836618.502366:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911360 00000100:00100000:0.0:1788836618.502368:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911360 00000100:00100000:0.0:1788836618.502378:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911872 00000100:00100000:0.0:1788836618.502388:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911872 00000100:00100000:0.0:1788836618.502410:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788836618.502419:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782911616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502490:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782911616:12345-0@lo:400:kworker.0 Request processed in 71us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.502498:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788836618.502519:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788836618.502525:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782912000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502557:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782912000:12345-0@lo:400:kworker.0 Request processed in 33us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.502562:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788836618.502574:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788836618.502580:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782912512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.502608:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782912512:12345-0@lo:400:kworker.0 Request processed in 29us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.503729:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788836618.503768:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788836618.503780:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782911360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.503860:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782911360:12345-0@lo:400:kworker.0 Request processed in 84us (6068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.503866:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788836618.503879:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788836618.503886:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.503986:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782911872:12345-0@lo:400:kworker.0 Request processed in 101us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.504037:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788836618.504087:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912256 00000100:00100000:0.0:1788836618.504095:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912256 00000100:00100000:0.0:1788836618.504158:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912768 00000100:00100000:0.0:1788836618.504162:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912768 00000100:00100000:0.0:1788836618.504179:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788836618.504185:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782912256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504204:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911488 00000100:00100000:1.0:1788836618.504210:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911488 00000100:00100000:0.0:1788836618.504227:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782912256:12345-0@lo:400:kworker.0 Request processed in 42us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.504233:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788836618.504244:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788836618.504245:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782911744 00000100:00100000:1.0:1788836618.504247:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782911744 00000100:00100000:0.0:1788836618.504250:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782912768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504261:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788836618.504267:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782911488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.504277:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875730782912768:12345-0@lo:400:kworker.0 Request processed in 28us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.504283:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788836618.504304:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782911488:12345-0@lo:400:kworker.0 Request processed in 37us (6671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.504310:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788836618.504316:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504319:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788836618.504347:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782911744:12345-0@lo:400:kworker.0 Request processed in 31us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836618.504363:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788836618.504380:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836618.504392:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912384 00000100:00100000:0.0:1788836618.504395:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912384 00000100:00100000:0.0:1788836618.504420:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788836618.504425:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782912384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504435:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782912896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836618.504453:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782912384:12345-0@lo:400:kworker.0 Request processed in 28us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836618.504467:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836618.504467:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1788836618.504487:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836618.504490:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782912896 00000100:00080000:0.0:1788836618.504492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836618.504494:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782912896 00000100:00080000:0.0:1788836618.504495:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836618.504497:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836618.504517:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836618.504523:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782912896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836618.504538:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782911616:0@lo:400:kworker.0 00002000:00000024:1.0:1788836618.504549:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788836618.504579:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782912896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836618.504585:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788836618.504596:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782911744:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504604:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000100:00100000:0.0:1788836618.504607:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782912256:0@lo:400:kworker.0 00000004:00080000:1.0:1788836618.504610:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade42a5c380, transno 4294967322 00000004:00080000:1.0:1788836618.504622:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788836618.504646:0:3617:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ade447c9880 x1875730782910592/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788836630 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836618.504664:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782912896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836618.504805:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782911488:0@lo:400:kworker.0 00010000:00080000:1.0:1788836618.504820:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d8380 x1875730782912000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836618.504829:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782912000:0@lo:400:kworker.0 00010000:00080000:1.0:1788836618.504857:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463dad80 x1875730782912512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836618.504877:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782912512:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504904:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782911360:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504917:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782911872:0@lo:400:kworker.0 00000100:00100000:1.0:1788836618.504926:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782912384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836618.505791:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782912768:0@lo:400:kworker.0 00010000:00010000:1.0:1788836618.625230:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836619.007322:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782913024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836619.007443:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836619.007592:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913024 00000100:00100000:2.0:1788836619.007603:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913024 00000100:00100000:2.0:1788836619.009104:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788836619.009127:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782913024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836619.009164:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788836619.009270:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782913024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836619.009278:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836619.009797:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782913024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836619.019298:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836619.019626:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279040 00000100:00100000:1.0:1788836619.019639:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279040 00000100:00080000:0.0:1788836619.019984:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836619.020132:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:1.0:1788836619.020147:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:12172:x1875730770279040:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788836619.020315:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:12172:x1875730770279040:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 172us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836619.020324:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:0.0:1788836619.024156:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836619.024372:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279168 00000100:00100000:1.0:1788836619.024386:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279168 00000100:00100000:1.0:1788836619.024491:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:1.0:1788836619.024506:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:12172:x1875730770279168:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788836619.024660:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:12172:x1875730770279168:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 158us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836619.024669:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:3.0:1788836619.028118:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00080000:0.0:1788836619.028856:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836619.029350:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279424 00000100:00100000:1.0:1788836619.029365:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279424 00000100:00100000:1.0:1788836619.029471:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788836619.029485:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:12172:x1875730770279424:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788836619.029810:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:12172:x1875730770279424:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 328us (1708us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788836619.029819:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788836619.267790:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836619.268002:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279552 00000100:00100000:0.0:1788836619.268056:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279552 00000100:00100000:0.0:1788836619.268167:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:0.0:1788836619.268181:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+5:12978:x1875730770279552:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:0.0:1788836619.268211:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788836619.268314:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836619.268510:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655506c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa65d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268603:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268621:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268638:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836619.268790:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836619.268794:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836619.268823:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268854:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a655506c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa65d expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268877:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa65d expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836619.268887:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:0.0:1788836619.268891:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836619.268896:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992c00, rc 0) 00000100:00100000:0.0:1788836619.268999:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af47d36a-929f-4c54-b0ec-8b3068716457+6:12978:x1875730770279552:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 808us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836619.269113:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 257 00010000:00010000:1.0:1788836619.646351:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836620.097650:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788836620.287067:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836620.287083:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836620.287249:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788836620.287274:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788836620.290582:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788836620.290606:0:6468:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788836620.290874:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788836620.290891:0:6522:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788836620.673992:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836621.054488:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836621.054532:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782913152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836621.054654:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836621.054925:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913152 00000100:00100000:0.0:1788836621.054937:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913152 00000100:00100000:0.0:1788836621.055053:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788836621.055065:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782913152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836621.055116:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788836621.055176:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782913152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836621.055184:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788836621.055339:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782913152:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788836621.064899:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:1.0:1788836621.694219:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836622.078369:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836622.078404:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782913280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836622.078525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836622.078754:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836622.078773:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836622.080227:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836622.086301:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913280 00000100:00100000:1.0:1788836622.086328:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913280 00000100:00100000:1.0:1788836622.086536:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913408 00000100:00100000:1.0:1788836622.086541:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913408 00000100:00100000:2.0:1788836622.086612:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788836622.086628:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782913280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836622.086675:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836622.086789:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782913280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (8265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.086798:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788836622.086902:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782913280:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788836622.090071:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836622.092572:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788836622.092594:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836622.092636:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836622.092773:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (12552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836622.092781:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788836622.092901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836622.284137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836622.284200:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836622.284246:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279808 00000100:00100000:0.0:1788836622.284247:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836622.284261:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279808 00000100:00100000:0.0:1788836622.284296:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836622.284326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836622.284387:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280064 00000100:00100000:1.0:1788836622.284392:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280064 00000100:00100000:1.0:1788836622.284454:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:1.0:1788836622.284466:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770280064:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836622.284560:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770280064:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 96us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836622.284569:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:1.0:1788836622.284750:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279680 00000100:00100000:1.0:1788836622.284754:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279680 00000100:00100000:1.0:1788836622.284784:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 401 00000100:00100000:1.0:1788836622.284790:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770279680:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836622.284823:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770279680:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836622.284830:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 401 00000100:00080000:1.0:1788836622.284866:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836622.284872:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836622.285620:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836622.285657:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836622.285681:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280192 00000100:00100000:0.0:1788836622.285687:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280192 00000100:00100000:2.0:1788836622.285698:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280320 00000100:00100000:2.0:1788836622.285704:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280320 00000100:00100000:0.0:1788836622.285731:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:0.0:1788836622.285742:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2397:x1875730770280192:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836622.285744:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770279936 00000100:00100000:2.0:1788836622.285749:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770279936 00000100:00100000:2.0:1788836622.285770:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280448 00000100:00100000:2.0:1788836622.285773:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280448 00000100:00100000:2.0:1788836622.285794:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 375 00000100:00100000:2.0:1788836622.285803:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2397:x1875730770279808:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836622.285810:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2397:x1875730770280192:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.285846:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2397:x1875730770279808:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 45us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.285854:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 375 00000100:00100000:2.0:1788836622.285868:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 376 00000100:00100000:2.0:1788836622.285874:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2397:x1875730770280320:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836622.285978:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+6:2397:x1875730770280320:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 103us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.286000:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 376 00000100:00100000:2.0:1788836622.286029:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 377 00000100:00100000:2.0:1788836622.286036:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770279936:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836622.286064:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2397:x1875730770279936:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.286071:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 377 00000100:00100000:2.0:1788836622.286083:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 378 00000100:00100000:2.0:1788836622.286089:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770280448:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836622.286114:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:af47d36a-929f-4c54-b0ec-8b3068716457+5:2397:x1875730770280448:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836622.286121:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 378 00000100:00080000:1.0:1788836622.286317:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836622.286321:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836622.286326:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836622.286573:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 165 00010000:00010000:1.0:1788836622.719237:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836623.107621:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782913536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836623.107725:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836623.110300:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913536 00000100:00100000:1.0:1788836623.110321:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913536 00000100:00100000:1.0:1788836623.110411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788836623.110422:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782913536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836623.110472:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788836623.110572:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782913536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836623.110579:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788836623.110648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782913536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836623.614796:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836623.615966:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782913792:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.616114:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836623.616226:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782914304:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.616283:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836623.616338:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836623.616347:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782914176:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.616401:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.616563:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782913920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.616987:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836623.617072:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782914688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.617128:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836623.617162:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782915200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.617198:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836623.617231:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836623.617247:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782914816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.617285:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836623.617352:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913664 00000100:00100000:2.0:1788836623.617376:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913664 00000100:00100000:3.0:1788836623.617971:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.618066:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782914432:0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.618143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.618188:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782914944:0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.618228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.618271:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836623.618278:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782914048:0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.618312:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.618337:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782914560:0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.618368:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.618396:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782915072:0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.619473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836623.619572:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914304 00000100:00100000:3.0:1788836623.619602:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914304 00000100:00100000:0.0:1788836623.619944:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913792 00000100:00100000:0.0:1788836623.619949:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913792 00000100:00100000:0.0:1788836623.620074:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788836623.620089:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782913792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.620291:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3615:x1875730782913792:12345-0@lo:400:kworker.0 Request processed in 205us (4177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836623.620311:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788836623.620394:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914816 00000100:00100000:0.0:1788836623.620398:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914816 00000100:00100000:3.0:1788836623.620522:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782913920 00000100:00100000:3.0:1788836623.620526:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782913920 00000100:00100000:3.0:1788836623.620554:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914432 00000100:00100000:3.0:1788836623.620557:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914432 00000100:00100000:2.0:1788836623.621236:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788836623.621262:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782913664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836623.621338:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788836623.621574:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914688 00000100:00100000:1.0:1788836623.621621:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914688 00000100:00100000:1.0:1788836623.621662:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915200 00000100:00100000:1.0:1788836623.621666:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915200 00000100:00100000:2.0:1788836623.623052:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782913664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1771us (6041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836623.623075:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788836623.623164:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914944 00000100:00100000:2.0:1788836623.623183:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914944 00000100:00100000:2.0:1788836623.623234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914048 00000100:00100000:2.0:1788836623.623237:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914048 00000100:00100000:2.0:1788836623.623267:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788836623.623277:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782914304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.623367:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782914304:12345-0@lo:400:kworker.0 Request processed in 91us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836623.623386:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788836623.623888:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788836623.623910:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.624077:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782913920:12345-0@lo:400:kworker.0 Request processed in 171us (6107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836623.624095:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788836623.624148:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788836623.624167:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782914944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.624231:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782914944:12345-0@lo:400:kworker.0 Request processed in 76us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836623.624247:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788836623.624273:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788836623.624281:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.624325:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782914048:12345-0@lo:400:kworker.0 Request processed in 45us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836623.624537:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788836623.624768:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782914048:0@lo:400:kworker.0 00010000:00080000:2.0:1788836623.624803:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428da680 x1875730782914944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836623.625907:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782914944:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.625959:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782913920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836623.626090:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788836623.626098:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade447c9880, transno 4294967325 00000100:00100000:2.0:1788836623.626150:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836623.626706:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788836623.626720:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782914816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.626894:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782914816:12345-0@lo:400:kworker.0 Request processed in 177us (9606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836623.626923:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788836623.627004:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914560 00000100:00100000:0.0:1788836623.627042:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914560 00000100:00100000:0.0:1788836623.627077:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915072 00000100:00100000:0.0:1788836623.627081:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915072 00000100:00100000:3.0:1788836623.630204:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788836623.630243:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782914432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.630738:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782914432:12345-0@lo:400:kworker.0 Request processed in 507us (12582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836623.630749:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00080000:3.0:1788836623.631378:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade428dbb80 x1875730782914432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836623.631399:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782914432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.632958:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836623.632987:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782914688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.633192:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782914688:12345-0@lo:400:kworker.0 Request processed in 222us (16063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836623.633217:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836623.633253:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788836623.633280:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782914560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836623.634214:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782914560:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.635763:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836623.635790:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782915200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.636194:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782915200:12345-0@lo:400:kworker.0 Request processed in 407us (18992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836623.636203:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836623.636237:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788836623.636255:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782915072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.636337:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782915072:12345-0@lo:400:kworker.0 Request processed in 82us (16869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836623.636344:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788836623.636741:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782914560:12345-0@lo:400:kworker.0 Request processed in 63us (14971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836623.636750:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788836623.638111:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836623.638123:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836623.638138:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836623.639571:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782915072:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.639751:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782914176 00000100:00100000:0.0:1788836623.639773:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782914176 00000100:00100000:0.0:1788836623.640705:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788836623.640745:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782914176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.641045:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3615:1875730782913792:0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.641079:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782914304:0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.641191:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782914816:0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.641216:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782914688:0@lo:400:kworker.0 00000100:00100000:1.0:1788836623.641239:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782915200:0@lo:400:kworker.0 00000100:00100000:0.0:1788836623.642173:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782914176:12345-0@lo:400:kworker.0 Request processed in 1407us (25744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836623.642189:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788836623.644740:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782914176:0@lo:400:kworker.0 00000001:02000400:3.0:1788836623.656171:0:14997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:03:41 (1788836621) 00010000:00010000:3.0:1788836623.744919:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836624.129803:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782915328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836624.129941:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836624.130515:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915328 00000100:00100000:1.0:1788836624.130544:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915328 00000100:00100000:1.0:1788836624.130783:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788836624.130826:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782915328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836624.130885:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788836624.131083:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782915328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 278us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836624.131092:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788836624.131210:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782915328:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788836624.767924:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836625.791205:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836626.174165:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836626.174192:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782915456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836626.174289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836626.176112:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915456 00000100:00100000:2.0:1788836626.176167:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915456 00000100:00100000:2.0:1788836626.176258:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788836626.176270:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782915456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836626.176321:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788836626.176421:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782915456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836626.176429:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788836626.176497:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782915456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836626.814446:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836627.199213:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836627.199243:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836627.199342:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836627.199530:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915584 00000100:00100000:2.0:1788836627.199540:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915584 00000100:00100000:2.0:1788836627.199645:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788836627.199659:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782915584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836627.199703:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836627.199768:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782915584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836627.199776:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788836627.199869:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836627.199915:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836627.200213:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782915712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836627.200253:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836627.200392:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915712 00000100:00100000:2.0:1788836627.200398:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915712 00000100:00100000:2.0:1788836627.200443:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788836627.200451:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782915712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836627.200466:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788836627.200522:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836627.200639:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782915712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836627.200647:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788836627.200702:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782915712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836627.402399:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836627.402462:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836627.402501:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836627.402616:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280832 00000100:00100000:3.0:1788836627.402632:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280832 00000100:00100000:1.0:1788836627.402678:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280576 00000100:00100000:1.0:1788836627.402686:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280576 00000100:00100000:1.0:1788836627.402741:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 403 00000100:00100000:1.0:1788836627.402753:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770280576:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836627.402860:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2394:x1875730770280576:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836627.402870:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 403 00000100:00080000:2.0:1788836627.402885:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836627.402931:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280704 00000100:00100000:3.0:1788836627.402936:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280704 00000100:00100000:3.0:1788836627.402981:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 385 00000100:00100000:3.0:1788836627.402990:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770280832:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836627.403074:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 386 00000100:00100000:3.0:1788836627.403081:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2394:x1875730770280832:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 91us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836627.403088:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2394:x1875730770280704:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836627.403095:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 385 00000100:00100000:1.0:1788836627.403130:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:2394:x1875730770280704:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836627.403138:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 386 00000100:00080000:2.0:1788836627.403349:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836627.409257:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836627.409356:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770280960 00000100:00100000:0.0:1788836627.409372:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770280960 00000100:00100000:0.0:1788836627.409487:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:0.0:1788836627.409500:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2393:x1875730770280960:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:0.0:1788836627.409539:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6554368 00000100:00080000:0.0:1788836627.409550:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf81443800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836627.409609:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1788836627.409620:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836627.409664:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836627.409837:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+2:2393:x1875730770280960:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 338us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836627.409846:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:1.0:1788836627.409993:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836627.410939:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770281088 00000100:00100000:0.0:1788836627.410949:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770281088 00000100:00100000:0.0:1788836627.411053:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:0.0:1788836627.411065:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770281088:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836627.411158:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2395:x1875730770281088:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 96us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836627.411167:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00080000:2.0:1788836627.411267:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836627.413173:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836627.413214:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836627.413462:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770281216 00000100:00100000:3.0:1788836627.413474:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770281216 00000100:00100000:3.0:1788836627.413617:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770281344 00000100:00100000:3.0:1788836627.413622:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770281344 00000100:00100000:3.0:1788836627.413659:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 387 00000100:00100000:0.0:1788836627.413674:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 388 00000100:00100000:0.0:1788836627.413688:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770281344:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836627.413778:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af47d36a-929f-4c54-b0ec-8b3068716457+5:2395:x1875730770281344:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 95us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836627.413787:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 388 00000100:00080000:2.0:1788836627.413915:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836627.413921:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836627.414072:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770281216:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836627.414118:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af47d36a-929f-4c54-b0ec-8b3068716457+6:2394:x1875730770281216:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 450us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.414125:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 387 00010000:00010000:1.0:1788836627.838410:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836628.226505:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782915840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836628.226611:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836628.227722:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915840 00000100:00100000:3.0:1788836628.227770:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915840 00000100:00100000:3.0:1788836628.227856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788836628.227869:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782915840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836628.227922:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788836628.228007:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782915840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836628.228043:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788836628.228194:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782915840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836628.734381:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.734500:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836628.734683:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916096 00000100:00100000:3.0:1788836628.734694:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916096 00000100:00100000:1.0:1788836628.734726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782916480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.734760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836628.734784:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836628.734790:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836628.734819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836628.734863:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782915968 00000100:00100000:1.0:1788836628.734868:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782915968 00000100:00100000:1.0:1788836628.734918:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788836628.734934:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782915968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836628.734971:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788836628.735044:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782915968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836628.735117:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788836628.735145:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836628.735197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836628.735234:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782916224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735267:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916480 00000100:00100000:1.0:1788836628.735273:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836628.735275:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916480 00000100:00100000:1.0:1788836628.735300:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836628.735308:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782916352:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735316:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788836628.735340:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836628.735341:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782916480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.735373:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916224 00000100:00100000:1.0:1788836628.735379:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916224 00000100:00100000:2.0:1788836628.735399:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782916480:12345-0@lo:400:kworker.0 Request processed in 64us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836628.735407:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788836628.735414:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916352 00000100:00100000:1.0:1788836628.735419:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916352 00000100:00100000:1.0:1788836628.735446:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788836628.735455:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782916224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735463:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788836628.735477:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782916352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735523:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782916352:12345-0@lo:400:kworker.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836628.735530:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788836628.735575:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782916224:12345-0@lo:400:kworker.0 Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836628.735584:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788836628.735614:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.735624:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782916224:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.735653:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782916480:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735843:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782916608:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735876:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836628.735919:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782916736:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.735924:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916608 00000100:00100000:2.0:1788836628.735929:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916608 00000100:00100000:1.0:1788836628.735952:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836628.735956:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788836628.735968:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.736035:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836628.736042:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782916864:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.736094:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916736 00000100:00100000:2.0:1788836628.736099:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916736 00000100:00100000:2.0:1788836628.736127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788836628.736135:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836628.736149:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3616:x1875730782916096:12345-0@lo:400:kworker.0 Request processed in 182us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836628.736158:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788836628.736202:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782917376:0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.740389:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836628.740477:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836628.740493:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782917248:0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.740598:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836628.740656:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917376 00000100:00100000:0.0:1788836628.740666:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917376 00000100:00100000:0.0:1788836628.740738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788836628.740749:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782917376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.740813:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782917376:12345-0@lo:400:kworker.0 Request processed in 66us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.740821:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788836628.740899:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782917376:0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.740970:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917248 00000100:00100000:0.0:1788836628.740974:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917248 00000100:00100000:0.0:1788836628.741009:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788836628.741042:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782916736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.741149:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782916736:12345-0@lo:400:kworker.0 Request processed in 110us (5200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.741155:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788836628.741167:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788836628.741171:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782917248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.741192:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782917248:12345-0@lo:400:kworker.0 Request processed in 21us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.741195:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00080000:0.0:1788836628.741215:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade43908700 x1875730782917248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836628.741223:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782917248:0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.741283:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782917120:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.741790:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782916608:12345-0@lo:400:kworker.0 Request processed in 5651us (5909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836628.741802:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788836628.741805:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788836628.741865:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade4390b480 x1875730782916736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836628.741877:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782916736:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.741901:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782916992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.741908:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916864 00000100:00100000:1.0:1788836628.741913:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916864 00000100:00100000:1.0:1788836628.741949:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836628.741952:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836628.741958:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782916864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.742002:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.742038:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782916864:12345-0@lo:400:kworker.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836628.742046:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836628.742053:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782916992 00000100:00100000:2.0:1788836628.742058:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782916992 00000100:00100000:2.0:1788836628.742083:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788836628.742101:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782916992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.742144:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782916992:12345-0@lo:400:kworker.0 Request processed in 43us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836628.742146:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782916864:0@lo:400:kworker.0 00000100:00100000:2.0:1788836628.742160:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1788836628.742186:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836628.742201:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836628.742205:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836628.742211:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782916992:0@lo:400:kworker.0 00000100:00100000:0.0:1788836628.744037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836628.744121:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782916608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836628.744157:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917120 00000100:00100000:1.0:1788836628.744169:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917120 00000100:00100000:1.0:1788836628.744256:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788836628.744267:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782917120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788836628.744420:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836628.744478:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782917120:12345-0@lo:400:kworker.0 Request processed in 213us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836628.744487:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788836628.744648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782917120:0@lo:400:kworker.0 00010000:00010000:3.0:1788836628.862694:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836629.247833:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836629.247869:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782917504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836629.247958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836629.248206:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917504 00000100:00100000:2.0:1788836629.248227:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917504 00000100:00100000:2.0:1788836629.248280:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836629.248291:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782917504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836629.248319:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788836629.248375:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782917504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836629.248382:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788836629.248938:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782917504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836629.573373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836629.573505:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770281600 00000100:00100000:0.0:1788836629.573516:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770281600 00000100:00100000:0.0:1788836629.573614:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:0.0:1788836629.573627:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+18:13202:x1875730770281600:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:0.0:1788836629.573948:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:13202:x1875730770281600:12345-192.168.201.38@tcp:35:umount.0 Request processed in 324us (585us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788836629.573957:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00080000:2.0:1788836629.574371:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836629.579216:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836629.579327:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770281856 00000100:00100000:3.0:1788836629.579337:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770281856 00000100:00100000:3.0:1788836629.579405:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1788836629.579418:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+19:13202:x1875730770281856:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:3.0:1788836629.579959:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:13202:x1875730770281856:12345-192.168.201.38@tcp:35:umount.0 Request processed in 542us (750us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788836629.579968:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1788836629.589820:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836629.590047:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770282112 00000100:00100000:1.0:1788836629.590057:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770282112 00000100:00100000:1.0:1788836629.590113:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:1.0:1788836629.590123:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+20:13202:x1875730770282112:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:1.0:1788836629.590348:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:13202:x1875730770282112:12345-192.168.201.38@tcp:35:umount.0 Request processed in 226us (546us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788836629.590356:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:2.0:1788836629.601537:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836629.601706:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770282368 00000100:00100000:1.0:1788836629.601717:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770282368 00000100:00100000:1.0:1788836629.601793:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788836629.601804:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:13202:x1875730770282368:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:1.0:1788836629.602144:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:13202:x1875730770282368:12345-192.168.201.38@tcp:35:umount.0 Request processed in 341us (614us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788836629.602152:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1788836629.608958:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836629.609003:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836629.609075:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836629.609170:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770282880 00000100:00100000:2.0:1788836629.609181:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770282880 00000100:00100000:2.0:1788836629.609243:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770283136 00000100:00100000:2.0:1788836629.609252:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770283136 00000100:00100000:2.0:1788836629.609268:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770283008 00000100:00100000:2.0:1788836629.609270:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770283008 00000100:00100000:2.0:1788836629.609286:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788836629.609294:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+15:2397:x1875730770282880:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836629.609312:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836629.609332:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f6c00/0xf7b38383a6553fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836629.609360:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836629.609410:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+14:2397:x1875730770282880:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 116us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836629.609418:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788836629.609436:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836629.609442:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+13:2397:x1875730770283136:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836629.609450:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836629.609459:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46400/0xf7b38383a6554265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa289 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836629.609469:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836629.609501:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+12:2397:x1875730770283136:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 59us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836629.609507:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836629.609521:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:2.0:1788836629.609527:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+11:2397:x1875730770283008:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836629.609535:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836629.609544:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700600/0xf7b38383a6553f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa171 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836629.609552:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836629.609569:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2397:x1875730770283008:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836629.609574:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788836629.610352:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836629.610510:0:8498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770282752 00000100:00100000:2.0:1788836629.610525:0:8498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770282752 00000100:00100000:2.0:1788836629.610573:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:2.0:1788836629.610581:0:8498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+7:2393:x1875730770282752:12345-192.168.201.38@tcp:9:umount.0 00000020:00000080:2.0:1788836629.610604:0:8498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65545de 00000020:00010000:2.0:1788836629.610611:0:8498:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adf506ed800: total 0 00000100:00080000:2.0:1788836629.610615:0:8498:0:(import.c:65:import_set_state_nolock()) ffff8adf506ec000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836629.610656:0:8498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1788836629.610898:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1788836629.610924:0:10309:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adf506ed800: total 0 00010000:00010000:1.0:1788836629.610974:0:10309:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adf506ed800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788836629.611041:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003861f538/0xf7b38383a6555065 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa656 expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.611087:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bca264e/0xf7b38383a6554996 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa473 expref: 5 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.611102:0:10309:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adf506ed800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788836629.611117:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836629.611118:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836629.611120:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836629.611693:0:8498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+2:2393:x1875730770282752:12345-192.168.201.38@tcp:9:umount.0 Request processed in 1109us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836629.611906:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:2.0:1788836629.625928:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836629.626129:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284160 00000100:00100000:0.0:1788836629.626143:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284160 00000100:00100000:0.0:1788836629.626228:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:0.0:1788836629.626247:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+22:2393:x1875730770284160:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:0.0:1788836629.626295:0:10333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f9b 00000020:00010000:0.0:1788836629.626317:0:10333:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ade42b5b800: total 0 00000100:00080000:0.0:1788836629.626323:0:10333:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836629.626364:0:10333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788836629.626566:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b8fbf20-a55f-40bb-87b6-19e878cca24b+21:2393:x1875730770284160:12345-192.168.201.38@tcp:39:umount.0 Request processed in 321us (651us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788836629.626574:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 258 00000020:00010000:1.0:1788836629.627271:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ade42b5b800: total 0 00010000:00010000:1.0:1788836629.627335:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ade42b5b800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788836629.627378:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836629.627382:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836629.627392:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6000/0xf7b38383a6554d08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa56f expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627417:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:1.0:1788836629.627420:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836629.627440:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eac00/0xf7b38383a65549ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa48f expref: 19 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627458:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836629.627461:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836629.627465:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a6554957 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa45e expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627479:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836629.627482:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788836629.627504:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf82173600/0xf7b38383a6554981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa46c expref: 17 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627520:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836629.627522:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836629.627526:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a6554639 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa38c expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627540:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ade43819800) 00010000:00010000:1.0:1788836629.627542:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836629.627545:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6200/0xf7b38383a65542e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa29e expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627563:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836629.627565:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836629.627568:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a6554f46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa609 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627582:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ade43819a00) 00010000:00010000:1.0:1788836629.627584:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836629.627587:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f6e00/0xf7b38383a65542c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa297 expref: 13 pid: 12185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627599:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adf439d0e00) 00010000:00010000:1.0:1788836629.627601:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836629.627604:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf7a700000/0xf7b38383a6554a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa496 expref: 12 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627617:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ade43819500) 00010000:00010000:1.0:1788836629.627623:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836629.627627:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7800/0xf7b38383a6554877 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa426 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627642:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836629.627644:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836629.627647:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615dc00/0xf7b38383a6555026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa641 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627658:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8adf77296d00) 00010000:00010000:1.0:1788836629.627660:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788836629.627663:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43ae6600/0xf7b38383a6555050 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa64f expref: 9 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627678:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8adf785f7900) 00010000:00010000:1.0:1788836629.627680:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836629.627684:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade438f7c00/0xf7b38383a655433e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa2b3 expref: 8 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.627696:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ade42b5b800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788836629.627717:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836629.627719:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836629.627721:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836629.638181:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836629.638295:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284288 00000100:00100000:2.0:1788836629.638311:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284288 00000100:00100000:2.0:1788836629.638404:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:2.0:1788836629.638418:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+5:2393:x1875730770284288:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:2.0:1788836629.638475:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553fa2 00000100:00080000:2.0:1788836629.638499:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8ade4396b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836629.638574:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788836629.638948:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b8fbf20-a55f-40bb-87b6-19e878cca24b+3:2393:x1875730770284288:12345-192.168.201.38@tcp:39:umount.0 Request processed in 532us (782us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788836629.638957:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00080000:1.0:1788836629.639259:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788836629.640373:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836629.886557:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836630.334985:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788836630.526410:0:13783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836630.526426:0:13783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836630.526544:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788836630.526552:0:13783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788836630.910502:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836631.294672:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782917632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836631.295428:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836631.296000:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917632 00000100:00100000:3.0:1788836631.296047:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917632 00000100:00100000:3.0:1788836631.296117:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788836631.297560:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782917632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836631.297623:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788836631.297746:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782917632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1618us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836631.297756:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788836631.298791:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782917632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836631.323518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836631.324423:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284544 00000100:00100000:2.0:1788836631.324440:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284544 00000100:00100000:2.0:1788836631.324540:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788836631.324570:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770284544:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836631.324591:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836631.324627:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992000/0xf7b38383a65540a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1f6 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836631.324648:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836631.324735:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:2395:x1875730770284544:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 168us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836631.324743:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788836631.339110:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836631.339152:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836631.339206:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836631.339290:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284416 00000100:00100000:1.0:1788836631.339304:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284416 00000100:00100000:1.0:1788836631.339387:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284672 00000100:00100000:1.0:1788836631.339391:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284672 00000100:00100000:1.0:1788836631.339448:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788836631.339461:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ffaddc-7971-40cd-b532-959b315f8e2b+10:2395:x1875730770284416:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836631.339484:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836631.339510:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993200/0xf7b38383a655409e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1c5 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836631.339533:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836631.339603:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ffaddc-7971-40cd-b532-959b315f8e2b+9:2395:x1875730770284416:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 145us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836631.339611:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788836631.339643:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1788836631.339651:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ffaddc-7971-40cd-b532-959b315f8e2b+8:2395:x1875730770284672:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836631.339658:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836631.339668:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46000/0xf7b38383a655425e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa282 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836631.339689:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836631.339709:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ffaddc-7971-40cd-b532-959b315f8e2b+7:2395:x1875730770284672:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 58us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836631.339715:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788836631.339931:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770284928 00000100:00100000:0.0:1788836631.339937:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770284928 00000100:00100000:0.0:1788836631.339997:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 260 00000100:00100000:0.0:1788836631.340005:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+6:2393:x1875730770284928:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:0.0:1788836631.340082:0:12185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65540ba 00000020:00010000:0.0:1788836631.340091:0:12185:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adf7fc1c800: total 0 00000100:00080000:0.0:1788836631.340097:0:12185:0:(import.c:65:import_set_state_nolock()) ffff8adf7fc1f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836631.340126:0:12185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788836631.340294:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:af47d36a-929f-4c54-b0ec-8b3068716457+5:2393:x1875730770284928:12345-192.168.201.38@tcp:39:umount.0 Request processed in 290us (1086us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788836631.340302:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 260 00000020:00010000:0.0:1788836631.340328:0:6477:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adf7fc1c800: total 0 00010000:00010000:0.0:1788836631.340332:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836631.340388:0:6477:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adf7fc1c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788836631.340419:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade438f2200) 00010000:00010000:0.0:1788836631.340434:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836631.340442:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992c00/0xf7b38383a6555073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa65d expref: 4 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836631.340467:0:6477:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adf7fc1c800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788836631.340479:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836631.340481:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836631.340483:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836631.341040:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836631.361827:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836631.361973:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285056 00000100:00100000:0.0:1788836631.361986:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285056 00000100:00100000:0.0:1788836631.362102:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 261 00000100:00100000:0.0:1788836631.362114:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+5:2393:x1875730770285056:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:0.0:1788836631.362189:0:10333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a65540b3 00000100:00080000:0.0:1788836631.362201:0:10333:0:(import.c:65:import_set_state_nolock()) ffff8ade43968000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836631.362242:0:10333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788836631.362447:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af47d36a-929f-4c54-b0ec-8b3068716457+3:2393:x1875730770285056:12345-192.168.201.38@tcp:39:umount.0 Request processed in 335us (636us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788836631.362456:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 261 00010000:00010000:3.0:1788836631.362977:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836631.364543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836631.426953:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836631.427153:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285312 00000100:00100000:0.0:1788836631.427167:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285312 00000100:00100000:0.0:1788836631.427257:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 405 00000100:00100000:0.0:1788836631.427269:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+7:2393:x1875730770285312:12345-192.168.201.38@tcp:251:umount.0 00000020:00000080:0.0:1788836631.427330:0:6483:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f78 00000020:00010000:0.0:1788836631.427341:0:6483:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ade42b5c000: total 0 00000100:00080000:0.0:1788836631.427347:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788836631.427461:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf78620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ffaddc-7971-40cd-b532-959b315f8e2b+3:2393:x1875730770285312:12345-192.168.201.38@tcp:251:umount.0 Request processed in 193us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836631.427470:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 405 00000020:00010000:1.0:1788836631.427685:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ade42b5c000: total 0 00010000:00010000:1.0:1788836631.427758:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ade42b5c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788836631.427807:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47800/0xf7b38383a6554019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa1b7 expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836631.427845:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ade42b5c000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788836631.427856:0:6478:0:(genops.c:885:class_export_put()) final put ffff8ade42b5c000/e3ffaddc-7971-40cd-b532-959b315f8e2b 00010000:00010000:1.0:1788836631.427872:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836631.427875:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836631.427876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836631.427957:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b5c000/e3ffaddc-7971-40cd-b532-959b315f8e2b for MGS 00000020:00000080:0.0:1788836631.428004:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b5f800 for MGS 00010000:00010000:2.0:1788836631.936744:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836632.319230:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836632.319263:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782917760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836632.319362:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836632.319451:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917760 00000100:00100000:0.0:1788836632.319462:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917760 00000100:00100000:0.0:1788836632.319543:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788836632.319555:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782917760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836632.319596:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788836632.319664:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782917760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836632.319672:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788836632.319700:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836632.319740:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782917760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836632.320061:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836632.320073:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782917888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836632.320106:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836632.320173:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782917888 00000100:00100000:1.0:1788836632.320179:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782917888 00000100:00100000:1.0:1788836632.320228:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788836632.320237:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782917888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836632.320249:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788836632.320284:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782917888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836632.320291:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1788836632.320371:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836632.320395:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782917888:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788836632.845676:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:3.0:1788836632.845691:0:8401:0:(genops.c:885:class_export_put()) final put ffff8adf81447800/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:3.0:1788836632.845747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf81447800/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-OST0000 00000020:00000080:3.0:1788836632.845817:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf81443800 for lustre-OST0000 00010000:00010000:1.0:1788836632.958743:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836633.342280:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836633.342317:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782918016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836633.342423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.342480:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918016 00000100:00100000:2.0:1788836633.342492:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918016 00000100:00100000:2.0:1788836633.342571:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788836633.342584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782918016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836633.342630:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788836633.342699:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782918016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836633.342707:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788836633.342898:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782918016:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1788836633.491610:0:15193:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788836633.505422:0:15193:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788836633.505494:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.505511:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.505519:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.505543:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.505574:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836633.505581:0:15193:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788836633.505635:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836633.505641:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788836633.505650:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836633.505684:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf65c85800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788836633.505788:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836633.505798:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.505806:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836633.505810:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.505821:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836633.505829:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836633.505836:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836633.505839:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836633.505842:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836633.505876:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.505895:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836633.505935:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.505944:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47200/0xf7b38383a655402e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554035 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.505958:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836633.505960:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836633.505962:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836633.505985:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782918144:0@lo:39:umount.0 00000100:00100000:0.0:1788836633.506098:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.506312:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782918272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836633.506350:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.506438:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918144 00000100:00100000:3.0:1788836633.506447:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918144 00000100:00100000:3.0:1788836633.506508:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788836633.506518:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875730782918144:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788836633.506556:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b9d 00000100:00080000:3.0:1788836633.506567:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8adf772b9000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788836633.506641:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3613:x1875730782918144:12345-0@lo:39:umount.0 Request processed in 123us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836633.506649:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788836633.506666:0:6491:0:(genops.c:885:class_export_put()) final put ffff8adf772be000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788836633.506718:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf65c85800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788836633.506730:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782918144:0@lo:39:umount.0 00000100:00080000:3.0:1788836633.506771:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836633.506774:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836633.506778:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788836633.507278:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836633.507292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf772be000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836633.507353:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf772b9000 for lustre-MDT0000 00010000:00010000:3.0:1788836633.511490:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511515:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511523:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511531:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511572:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836633.511579:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511586:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511592:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511598:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511611:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836633.511618:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511624:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511650:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511656:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511676:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788836633.511684:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511692:0:15193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511699:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511705:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836633.511713:0:15193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788836633.511717:0:15193:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788836633.511787:0:15193:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788836633.511793:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788836633.511798:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836633.511805:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788836633.511816:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ade42b5a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836633.511822:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8adf7a4a0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836633.511827:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8adf44823000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836633.511837:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8adf80946800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788836633.511845:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8adf7fc1c800 af47d36a-929f-4c54-b0ec-8b3068716457 192.168.201.38@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836633.511850:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ade42b5b800 9b8fbf20-a55f-40bb-87b6-19e878cca24b 192.168.201.38@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788836633.511856:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8adf65ce8000) has exports, disconnecting them 00000020:00080000:3.0:1788836633.511861:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ade42b5a000), last request at 1788836628 00000020:00000080:3.0:1788836633.511870:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e9f 00000100:00080000:3.0:1788836633.511893:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788836633.511960:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade42b5a000): rc 0 00000020:00000080:3.0:1788836633.511963:0:15193:0:(genops.c:885:class_export_put()) final put ffff8ade42b5a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788836633.511976:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adf7a4a0800), last request at 1788836628 00000020:00000080:3.0:1788836633.511979:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d79 00000100:00080000:3.0:1788836633.511985:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788836633.511992:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf7a4a0800): rc 0 00000020:00000080:3.0:1788836633.511994:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf7a4a0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788836633.511998:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adf44823000), last request at 1788836382 00000020:00000080:3.0:1788836633.512001:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c76 00000100:00080000:3.0:1788836633.512004:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf44822800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788836633.512034:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf44823000): rc 0 00000020:00000080:3.0:1788836633.512037:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44823000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788836633.512042:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adf80946800), last request at 1788836382 00000020:00000080:3.0:1788836633.512045:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c45 00000100:00080000:3.0:1788836633.512049:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf77f52800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836633.512056:0:15193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788836633.512150:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf80946800): rc 0 00000004:00000080:3.0:1788836633.512158:0:15193:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb2ab07affae0 00000100:00080000:3.0:1788836633.512180:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788836633.512190:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788836633.512816:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788836633.512828:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.512852:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836633.512856:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.512866:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836633.512873:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836633.512880:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836633.512883:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788836633.512886:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788836633.512933:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.512940:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836633.512975:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.512982:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700e00/0xf7b38383a655403c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554043 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.512997:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836633.513001:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513008:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836633.513025:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513039:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836633.513046:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836633.513051:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836633.513054:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788836633.513056:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788836633.513071:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513076:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836633.513083:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513090:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6553f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553f39 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513101:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836633.513105:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513111:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836633.513113:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513120:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836633.513137:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836633.513143:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788836633.513145:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788836633.513147:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788836633.513162:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513168:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836633.513186:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513193:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47e00/0xf7b38383a6554296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655429d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513203:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836633.513207:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513214:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836633.513217:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513224:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836633.513230:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836633.513248:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836633.513250:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788836633.513252:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788836633.513266:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513272:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836633.513279:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513285:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf82173200/0xf7b38383a6553aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553af5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.513297:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836633.513299:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836633.513301:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836633.513317:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b5a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836633.513374:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a4a0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836633.513407:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44823000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836633.513433:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b5a800 for lustre-MDT0000 00000020:00000080:2.0:1788836633.513439:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7a4a3000 for lustre-MDT0000 00000020:00000080:2.0:1788836633.513442:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf44822800 for lustre-MDT0000 00000100:00100000:2.0:1788836633.513466:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782918400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.513558:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.513622:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836633.513628:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782918528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.513651:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.513690:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782918656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.513714:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.513732:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836633.513738:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782918784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836633.513952:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918272 00000100:00100000:0.0:1788836633.513962:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918272 00000100:00100000:0.0:1788836633.514029:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918400 00000100:00100000:0.0:1788836633.514033:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918400 00000100:00100000:0.0:1788836633.514047:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918528 00000100:00100000:0.0:1788836633.514050:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918528 00000100:00100000:0.0:1788836633.514061:0:13174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918656 00000100:00100000:0.0:1788836633.514063:0:13174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918656 00000100:00100000:0.0:1788836633.514079:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836633.514090:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+27:3617:x1875730782918272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836633.514107:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836633.514126:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701000/0xf7b38383a6554035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655402e expref: 27 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.514141:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836633.514194:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+26:3617:x1875730782918272:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836633.514213:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836633.514235:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836633.514241:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+25:3614:x1875730782918400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836633.514249:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836633.514258:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993a00/0xf7b38383a6554043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655403c expref: 25 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.514267:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836633.514297:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+24:3614:x1875730782918400:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836633.514303:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836633.514315:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836633.514320:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+23:3614:x1875730782918528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836633.514328:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836633.514337:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429ea400/0xf7b38383a6553f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553f32 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.514348:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836633.514368:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+22:3614:x1875730782918528:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836633.514374:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836633.514386:0:13174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836633.514391:0:13174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+21:3616:x1875730782918656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836633.514398:0:13174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836633.514407:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f6600/0xf7b38383a655429d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6554296 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836633.514425:0:13174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836633.514447:0:13174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3616:x1875730782918656:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836633.514454:0:13174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788836633.514476:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836633.514619:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.514664:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782918656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.514700:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3617:1875730782918272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.514732:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918784 00000100:00100000:2.0:1788836633.514735:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918784 00000100:00100000:2.0:1788836633.514773:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836633.514779:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf65e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+20:3616:x1875730782918784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836633.514788:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836633.514797:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82045e00/0xf7b38383a6553af5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553aee expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836633.514809:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836633.514835:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf65e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb+19:3616:x1875730782918784:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836633.514841:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836633.514893:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782918528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.514901:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782918400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836633.514921:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782918784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836633.515335:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836633.517541:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788836633.517584:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf77347800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788836633.517677:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782918912:0@lo:39:umount.0 00000100:00100000:0.0:1788836633.517778:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.517887:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782918912 00000100:00100000:3.0:1788836633.517898:0:7800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782918912 00000100:00100000:3.0:1788836633.517961:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788836633.517972:0:7800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1875730782918912:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788836633.518035:0:7800:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553cd1 00000100:00080000:3.0:1788836633.518046:0:7800:0:(import.c:65:import_set_state_nolock()) ffff8adf80944000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836633.518077:0:7800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788836633.519286:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836633.527784:0:7800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3613:x1875730782918912:12345-0@lo:39:umount.0 Request processed in 9799us (9991us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788836633.527805:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1788836633.528090:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836633.528097:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788836633.528127:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788836633.528209:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788836633.528249:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf46eab000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788836633.528265:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836633.528268:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788836633.528281:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788836633.528338:0:15193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788836633.528348:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf77de7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788836633.528382:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8adf65ce8000) has no exports 00000100:00080000:0.0:1788836633.534561:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf77347800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788836633.534583:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782918912:0@lo:39:umount.0 00000100:00100000:2.0:1788836633.536212:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782919040:0@lo:9:umount.0 00000100:00100000:2.0:1788836633.536336:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.536386:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782919168:0@lo:9:umount.0 00000100:00100000:2.0:1788836633.536412:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.536455:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919040 00000100:00100000:2.0:1788836633.536466:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919040 00000100:00100000:2.0:1788836633.536525:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919168 00000100:00100000:2.0:1788836633.536528:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919168 00000100:00100000:2.0:1788836633.536569:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836633.536579:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1875730782919040:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836633.536618:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e2f 00000100:00080000:2.0:1788836633.536629:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ade4252b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836633.536685:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788836633.536875:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3613:x1875730782919040:12345-0@lo:9:umount.0 Request processed in 297us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836633.536883:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836633.536902:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836633.536908:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1875730782919168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836633.536921:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f63 00000100:00080000:2.0:1788836633.536928:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ade4396f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836633.536956:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788836633.537054:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3613:x1875730782919168:12345-0@lo:9:umount.0 Request processed in 145us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836633.537061:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788836633.537086:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788836633.537101:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836633.537108:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836633.537139:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf77de7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836633.537154:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836633.537166:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836633.537171:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782919168:0@lo:9:umount.0 00000100:00080000:2.0:1788836633.537216:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf46eab000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836633.537228:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836633.537230:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836633.537233:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782919040:0@lo:9:umount.0 00000020:00080000:0.0:1788836633.552491:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8adf65ce8000) has no exports 00000020:00000080:0.0:1788836633.625573:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b49 00000020:00000080:0.0:1788836633.625589:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf770e5800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788836633.625614:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788836633.625672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf770e5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788836633.625763:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836633.625779:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836633.625786:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8adf442a0000) has no exports 00000020:00000080:3.0:1788836633.627906:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b42 00000020:00000080:3.0:1788836633.627921:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44482000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788836633.627991:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836633.628049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44482000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836633.628053:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788836633.628063:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44485800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788836633.628068:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44485800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788836633.628078:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1788836633.856495:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782919680:0@lo:400:kworker.0 00000100:00100000:2.0:1788836633.856600:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.856695:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788836633.856703:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782919552:0@lo:400:kworker.0 00000100:00100000:2.0:1788836633.856749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836633.856770:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782920064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836633.856798:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.856995:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782919296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836633.857066:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.857098:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782919808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836633.857122:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.857144:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788836633.857149:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782919424:0@lo:400:kworker.0 00000100:00100000:3.0:1788836633.857171:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.857190:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782919936:0@lo:400:kworker.0 00000100:00100000:3.0:1788836633.857229:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.857262:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919552 00000100:00100000:3.0:1788836633.857271:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919552 00000100:00100000:3.0:1788836633.857336:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919296 00000100:00100000:3.0:1788836633.857340:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919296 00000100:00100000:3.0:1788836633.857351:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919808 00000100:00100000:3.0:1788836633.857353:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919808 00000100:00100000:3.0:1788836633.857361:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919424 00000100:00100000:3.0:1788836633.857364:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919424 00000100:00100000:3.0:1788836633.857371:0:10681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919936 00000100:00100000:3.0:1788836633.857373:0:10681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919936 00000100:00100000:3.0:1788836633.857397:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788836633.857406:0:10681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782919552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836633.857534:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788836633.857546:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782919936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836633.857593:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782919936:12345-0@lo:400:kworker.0 Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836633.857601:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788836633.857626:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788836633.857630:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919296:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788836633.857637:0:12185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788836633.857661:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919296:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788836633.857667:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788836633.857678:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788836633.857701:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919808:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788836633.857706:0:12185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788836633.857730:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919808:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788836633.857746:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788836633.857759:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788836633.857763:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919424:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788836633.857767:0:12185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788836633.857788:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3614:x1875730782919424:12345-0@lo:400:kworker.0 Request processed in 24us (616us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788836633.857794:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788836633.857855:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836633.861370:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782919680 00000100:00100000:1.0:1788836633.861396:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782919680 00000100:00100000:1.0:1788836633.861478:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920064 00000100:00100000:1.0:1788836633.861482:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920064 00000100:00100000:1.0:1788836633.861532:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788836633.861546:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782919680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836633.862036:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782919680:12345-0@lo:400:kworker.0 Request processed in 468us (5410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836633.862045:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788836633.862089:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788836633.862096:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782920064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836633.862134:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782920064:12345-0@lo:400:kworker.0 Request processed in 38us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836633.862141:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1788836633.862240:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836633.862247:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788836633.862252:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788836633.863718:0:10681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782919552:12345-0@lo:400:kworker.0 Request processed in 6301us (6971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836633.863746:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:0.0:1788836633.864003:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788836633.864103:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade445e3800 x1875730782919552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836633.864121:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782919552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836633.864142:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782920064:0@lo:400:kworker.0 00000100:00100000:0.0:1788836633.864154:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782919680:0@lo:400:kworker.0 00000100:00080000:1.0:1788836633.882947:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836633.882962:0:3614:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1788836633.882973:0:3614:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ade41e65800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836633.883078:0:3614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428da680 x1875730782920192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836633.883116:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782919424:0@lo:400:kworker.0 00010000:00080000:1.0:1788836633.883155:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade445e0380 x1875730782919936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836633.883168:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782919936:0@lo:400:kworker.0 00000100:00080000:1.0:1788836633.883186:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836633.883190:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788836633.883194:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788836633.883197:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836633.883201:0:3614:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 166 00000100:00080000:1.0:1788836633.883205:0:3614:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8adf65c60800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836633.883238:0:3614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428db480 x1875730782920320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836633.883249:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782919296:0@lo:400:kworker.0 00000100:00080000:1.0:1788836633.883264:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836633.883267:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788836633.883270:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788836633.883274:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836633.883276:0:3614:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1788836633.883280:0:3614:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adf8145b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836633.883293:0:3614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428d8e00 x1875730782920448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836633.883305:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782919808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836633.883758:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782920192:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788836633.883881:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.883989:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782920320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788836633.884177:0:12185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920192 00000100:00100000:0.0:1788836633.884188:0:12185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920192 00000100:00100000:0.0:1788836633.884259:0:12185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788836633.884268:0:12185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3613:x1875730782920192:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788836633.884290:0:12185:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788836633.884727:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.884784:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782920448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788836633.884829:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836633.884862:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920320 00000100:00100000:3.0:1788836633.884867:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920320 00000100:00100000:3.0:1788836633.884897:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920448 00000100:00100000:3.0:1788836633.884900:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920448 00000100:00100000:3.0:1788836633.884920:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788836633.884925:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782920320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788836633.884935:0:6491:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788836633.884980:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782920320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (254us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836633.884988:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788836633.885007:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788836633.885033:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782920448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788836633.885040:0:6491:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788836633.885067:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782920448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 54us (246us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836633.885076:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788836633.885362:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836633.885369:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836633.885373:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782920448:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788836633.885402:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836633.885423:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836633.885427:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782920320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788836633.898972:0:12185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3613:x1875730782920192:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 14692us (15080us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836633.899005:0:12185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788836633.899587:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836633.899594:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836633.899598:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782920192:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788836633.983324:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836634.366468:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782920576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836634.366581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836634.369376:0:10185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920576 00000100:00100000:3.0:1788836634.369399:0:10185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920576 00000100:00100000:3.0:1788836634.369504:0:10185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788836634.369519:0:10185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782920576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836634.369569:0:10185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788836634.369679:0:10185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782920576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836634.369689:0:10185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836634.370973:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782920576:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788836634.880266:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836634.880283:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf77de4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788836634.880308:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:1.0:1788836634.880311:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf506ed800/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:0.0:1788836634.881525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77de4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788836634.883524:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf506ed800/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-OST0001 00000020:00000080:0.0:1788836634.883673:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade4396f000 for lustre-OST0001 00000020:00000080:0.0:1788836634.883680:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf506ec000 for lustre-OST0001 00000001:00100000:3.0:1788836634.887455:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788836634.887473:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788836634.887479:0:7421:0:(genops.c:885:class_export_put()) final put ffff8adf7a54d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788836634.887502:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00080000:3.0:1788836634.887507:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788836634.887510:0:7421:0:(genops.c:885:class_export_put()) final put ffff8ade43969800/af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:3.0:1788836634.887515:0:7421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000001:00080000:3.0:1788836634.887519:0:7421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788836634.887521:0:7421:0:(genops.c:885:class_export_put()) final put ffff8ade43969000/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000001:00100000:0.0:1788836634.888137:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836634.888153:0:6468:0:(genops.c:885:class_export_put()) final put ffff8adf80946800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788836634.888162:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00080000:0.0:1788836634.888167:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788836634.888170:0:6468:0:(genops.c:885:class_export_put()) final put ffff8adf7fc1c800/af47d36a-929f-4c54-b0ec-8b3068716457 00000001:00100000:0.0:1788836634.888178:0:6468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000001:00080000:0.0:1788836634.888181:0:6468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788836634.888196:0:6468:0:(genops.c:885:class_export_put()) final put ffff8ade42b5b800/9b8fbf20-a55f-40bb-87b6-19e878cca24b 00000020:00000080:2.0:1788836634.888308:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a54d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788836634.888481:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade43969800/af47d36a-929f-4c54-b0ec-8b3068716457 for lustre-MDT0001 00000020:00000080:2.0:1788836634.888502:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade43969000/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-MDT0001 00000020:00000080:2.0:1788836634.888523:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80946800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836634.888544:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fc1c800/af47d36a-929f-4c54-b0ec-8b3068716457 for lustre-MDT0000 00000020:00000080:2.0:1788836634.888565:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b5b800/9b8fbf20-a55f-40bb-87b6-19e878cca24b for lustre-MDT0000 00000020:00000080:2.0:1788836634.888589:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf80944000 for lustre-MDT0001 00000020:00000080:2.0:1788836634.888594:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade43968000 for lustre-MDT0001 00000020:00000080:2.0:1788836634.888597:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade4396b800 for lustre-MDT0001 00000020:00000080:2.0:1788836634.888600:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf77f52800 for lustre-MDT0000 00000020:00000080:2.0:1788836634.888603:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7fc1f000 for lustre-MDT0000 00000020:00000080:2.0:1788836634.888606:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b5f000 for lustre-MDT0000 00010000:00010000:2.0:1788836635.006341:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788836635.646170:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ade426d0480 - data ffff8adf6ce5b438/ffff8adf81466400 00000020:01000000:2.0:1788836635.646355:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adf65d64cc0 - data ffff8adf6cd8a0d8/ffff8adf772a4800 00000001:00000004:2.0:1788836635.651619:0:15193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788836635.717631:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788836635.717640:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788836635.717657:0:15193:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ade44551180 x1875730782918912/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788836643 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836635.717700:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788836635.725563:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836635.725572:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788836635.725596:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836635.725599:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788836635.725852:0:8494:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788836635.725857:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788836635.725867:0:8494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788836635.726472:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836635.726476:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788836635.726494:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836635.726496:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788836635.726745:0:10024:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788836635.726749:0:10024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788836635.726756:0:10024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788836635.730403:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b11 00000020:00000080:1.0:1788836635.730419:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf444f4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836635.731230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836635.744362:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b26 00000020:00000080:1.0:1788836635.744376:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44824800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836635.744416:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788836635.744421:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836635.744431:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788836635.744437:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8adf65cecd28) has no exports 00000004:01000000:1.0:1788836635.744619:0:15193:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788836635.744628:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f5c 00000020:00000080:1.0:1788836635.744632:0:15193:0:(genops.c:885:class_export_put()) final put ffff8ade41e62800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836635.744637:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788836635.744640:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836635.744649:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836635.744652:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8ade42540000) has no exports 00000020:00000080:1.0:1788836635.744659:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f55 00000020:00000080:1.0:1788836635.744662:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf77de2000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788836635.745042:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788836635.745047:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788836635.745051:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788836635.745321:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836635.745324:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836635.745356:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836635.745366:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836635.745373:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e1a 00000020:00000080:1.0:1788836635.745379:0:15193:0:(genops.c:885:class_export_put()) final put ffff8ade4252a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836635.745383:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788836635.745387:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836635.745390:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836635.745393:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8adf7fb83370) has no exports 00000020:00000080:1.0:1788836635.745397:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e13 00000020:00000080:1.0:1788836635.745400:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf77346800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788836635.745787:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788836635.745790:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788836635.745793:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788836635.745796:0:15193:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836635.745805:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836635.745828:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836635.745834:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788836635.745846:0:15193:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788836635.745851:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553cca 00000020:00000080:1.0:1788836635.745858:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf65c66800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836635.745861:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788836635.745864:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836635.745868:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836635.745870:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8adf442a3370) has no exports 00000020:00000080:1.0:1788836635.745874:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553cc3 00000020:00000080:1.0:1788836635.745876:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf77340800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788836635.746790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44824800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788836635.746805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade41e62800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788836635.746810:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77de2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836635.746816:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf77de7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788836635.746822:0:8:0:(genops.c:885:class_export_put()) final put ffff8ade41e66000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836635.746824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade41e66000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788836635.746829:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836635.746911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788836635.746917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77346800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836635.746922:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf46eab000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788836635.746927:0:8:0:(genops.c:885:class_export_put()) final put ffff8ade4252d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836635.746929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788836635.746933:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836635.746958:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf65c66800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788836635.746963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77340800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788836635.748259:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788836635.748266:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788836635.748269:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788836635.748277:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836635.748323:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836635.748337:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836635.748364:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836635.748367:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836635.748372:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf444f5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788836635.748375:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788836635.748381:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836635.748474:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b2d 00000020:00000080:0.0:1788836635.748481:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44827000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788836635.748485:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788836635.748489:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836635.748493:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836635.748496:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8adf65ceb370) has no exports 00000020:00000080:0.0:1788836635.748515:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836635.748518:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788836635.748522:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b34 00000020:00000080:0.0:1788836635.748525:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf44822000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788836635.748533:0:15193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf50b59800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788836635.748536:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf50b59800 3 00000020:01000004:0.0:1788836635.748539:0:15193:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adf50b59800 from lustre-MDT0000 00000020:00000080:0.0:1788836635.748557:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836635.748560:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788836635.748563:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf444f7000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788836635.748565:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788836635.748572:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788836635.748599:0:15193:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788836635.748602:0:15193:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788836635.748605:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788836635.748608:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836635.748611:0:15193:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836635.748617:0:15193:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8adf65c87000 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836635.748622:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8adf65ce99b8) has exports, disconnecting them 00000020:00080000:0.0:1788836635.748626:0:15193:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8adf65c87000), last request at 1788836358 00000020:00000080:0.0:1788836635.748642:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553ad2 00000020:00010000:0.0:1788836635.748646:0:15193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adf65c87000: total 2 00000100:00080000:0.0:1788836635.748650:0:15193:0:(import.c:65:import_set_state_nolock()) ffff8adf65c84800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836635.748663:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf65c87000): rc 0 00000020:00080000:0.0:1788836635.748667:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8adf65ce99b8) has no exports 00000100:00100000:0.0:1788836635.748740:0:6483:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8adf584bf600:6483] 0 exiting: rc = 1 00000100:00100000:3.0:1788836635.748896:0:6485:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8adf47c39e00:6485] 2 exiting: rc = 0 00000020:00000080:3.0:1788836635.748949:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf77347800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788836635.748963:0:8:0:(genops.c:885:class_export_put()) final put ffff8adf5db4d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836635.748965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf5db4d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788836635.748969:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836635.749041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44827000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788836635.749045:0:8:0:(genops.c:885:class_export_put()) final put ffff8adf444f6800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788836635.749047:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788836635.749051:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788836635.749246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44822000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788836635.749269:0:6478:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adf65c87000: total 0 00010000:00010000:3.0:1788836635.749289:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adf65c87000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788836635.749322:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82045200/0xf7b38383a6553bce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553bc7 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749344:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992600/0xf7b38383a6553fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553fe1 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749356:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993800/0xf7b38383a6554027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6554020 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749366:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf82044e00/0xf7b38383a6553bdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553bd5 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749378:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701600/0xf7b38383a6553ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553fef expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749390:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46a00/0xf7b38383a6554273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655426c expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749401:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f7e00/0xf7b38383a6554004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553ffd expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749424:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47400/0xf7b38383a6553fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553fcc expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749433:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46e00/0xf7b38383a6554281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655427a expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749442:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992800/0xf7b38383a6554012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655400b expref: 5 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749451:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f47c00/0xf7b38383a655428f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6554288 expref: 4 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749464:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf40030200/0xf7b38383a6553ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a6553eec expref: 3 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749475:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade438f7600/0xf7b38383a6554051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7b38383a655404a expref: 2 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836635.749485:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adf65c87000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788836635.749500:0:6478:0:(genops.c:885:class_export_put()) final put ffff8adf65c87000/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb 00010000:00010000:3.0:1788836635.749546:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836635.749549:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836635.749551:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836635.749595:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8adf47c39400:6484] 1 exiting: rc = 0 00000020:00000080:0.0:1788836635.753208:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf65c87000/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb for MGS 00000020:00000080:0.0:1788836635.753259:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf65c84800 for MGS 00000100:00100000:0.0:1788836635.753320:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753332:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753338:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753344:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753351:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753357:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753363:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753369:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753375:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753382:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753389:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753395:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753402:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753409:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753414:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753420:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753427:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753433:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753439:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753445:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753452:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753458:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753464:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753470:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753476:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753485:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753492:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753498:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753505:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753511:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753518:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753524:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753530:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753550:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753556:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753562:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753567:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753573:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753579:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753584:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753590:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753595:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753601:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753606:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753612:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753617:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753622:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753629:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753635:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753641:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753646:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753650:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753656:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753662:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753666:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753672:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753678:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753683:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753688:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753693:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753698:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753714:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753720:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836635.753725:0:15193:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788836635.755817:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ade426d05a0 - data ffff8adf6cf216c0/ffff8adf8146f000 00000020:01000000:0.0:1788836635.755956:0:15193:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adf49989ea0 - data ffff8adf6cc55870/ffff8adf787c4c00 00000020:00000080:0.0:1788836635.756660:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553ab6 00000020:00000080:0.0:1788836635.756680:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf4395b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788836635.756697:0:15193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf50b59800 from MGS, refs=2 00000020:01000004:0.0:1788836635.756701:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf50b59800 2 00000020:01000004:0.0:1788836635.756712:0:15193:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adf50b59800 from MGS 00000020:00000080:0.0:1788836635.756732:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836635.756738:0:15193:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788836635.756740:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf4395b000/MGS 00000020:00000080:0.0:1788836635.756743:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf4395b000/MGS for MGS 00000020:01000000:0.0:1788836635.756749:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788836635.756806:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788836635.756809:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836635.756815:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836635.756821:0:15193:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8adf444f6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836635.756827:0:15193:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8adf771399b8) has exports, disconnecting them 00000020:00080000:0.0:1788836635.756831:0:15193:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8adf444f6000), last request at 1788836359 00000020:00000080:0.0:1788836635.756835:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553b81 00000020:00080000:0.0:1788836635.756845:0:15193:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf444f6000): rc 0 00000020:00000080:0.0:1788836635.756850:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf444f6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788836635.757162:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf4395b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836635.757169:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788836635.905071:0:15193:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788836635.905079:0:15193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836635.905084:0:15193:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788836635.905101:0:15193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836635.905143:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf65c85800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788836635.905310:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836635.905319:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788836635.905325:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf5db4f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788836635.905328:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf5db4f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788836635.905337:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788836635.905419:0:15193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf50b59800 1 00000020:00000080:3.0:1788836635.905425:0:15193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553aa8 00000020:00000080:3.0:1788836635.905432:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf4395f000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788836635.905440:0:15193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788836635.905448:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf4395f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836635.905457:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836635.905461:0:15193:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788836635.905465:0:15193:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8adf442a4d28) has no exports 00000020:00000080:2.0:1788836636.013929:0:15193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836636.013939:0:15193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788836636.013945:0:15193:0:(genops.c:885:class_export_put()) final put ffff8adf50b5f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788836636.013949:0:15193:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf50b5f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788836636.013954:0:15193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788836636.014090:0:15193:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adf50b5c800 00000020:02000400:2.0:1788836636.014252:0:15193:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788836636.034742:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836637.054195:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836637.457607:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782920704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836637.457695:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836637.457902:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920704 00000100:00100000:2.0:1788836637.457912:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920704 00000100:00100000:2.0:1788836637.457980:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836637.457991:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782920704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836637.458050:0:8409:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788836637.458097:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782920704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.458104:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788836637.459054:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836637.459112:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782920704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788836638.078251:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836638.472382:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782920832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836638.472467:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836638.472670:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920832 00000100:00100000:3.0:1788836638.472680:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920832 00000100:00100000:3.0:1788836638.472734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788836638.472743:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875730782920832:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788836638.472753:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788836638.472803:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875730782920832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (334us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788836638.472809:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:02020000:2.0:1788836638.473376:0:3615:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788836638.484209:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788836638.484219:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8adf77de1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788836638.484226:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788836638.507993:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8adf77de1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836638.508040:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 166 00000100:00080000:2.0:1788836638.508049:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8adf77de1000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836638.517165:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e0000 x1875730782920960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836638.517411:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782920960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788836638.517476:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.524904:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782920960 00000100:00100000:2.0:1788836638.524922:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782920960 00000100:00100000:2.0:1788836638.524980:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788836638.524991:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782920960:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788836638.525043:0:6495:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836638.525352:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782920960:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 361us (7874us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836638.525361:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:0.0:1788836638.525813:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf77de1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836638.525820:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836638.525824:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782920960:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1788836638.983879:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788836638.983892:0:8401:0:(genops.c:885:class_export_put()) final put ffff8ade4252f800/lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1788836638.983912:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836638.983917:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836638.983921:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836638.983930:0:13965:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788836638.983945:0:13965:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836638.983954:0:13965:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8adf65c60800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836638.983983:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7736a680 x1875730782921216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836638.984044:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836638.984049:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836638.984051:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836638.984055:0:13965:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788836638.984058:0:13965:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836638.984062:0:13965:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ade41e65800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836638.984086:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7736ad80 x1875730782921344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836638.984120:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836638.984123:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836638.984125:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836638.984128:0:13965:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788836638.984131:0:13965:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836638.984134:0:13965:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adf8145b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836638.984145:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7736b100 x1875730782921728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1788836638.984170:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000100:00100000:2.0:1788836638.984705:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782921216:0@lo:38:kworker.0 00000100:00100000:1.0:1788836638.984706:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782921088:0@lo:400:kworker.0 00000020:00000080:3.0:1788836638.984804:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade4252b800 for lustre-OST0000 00000100:00100000:3.0:1788836638.984824:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782921472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836638.986676:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.986935:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782921344:0@lo:38:kworker.0 00000100:00100000:2.0:1788836638.986974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.987002:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782921728:0@lo:38:kworker.0 00000100:00100000:2.0:1788836638.987042:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.987090:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782921856:0@lo:400:kworker.0 00000100:00100000:2.0:1788836638.987114:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.987138:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836638.987144:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782921600:0@lo:400:kworker.0 00000100:00100000:2.0:1788836638.987170:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836638.987222:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921216 00000100:00100000:2.0:1788836638.987230:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921216 00000100:00100000:2.0:1788836638.987262:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921344 00000100:00100000:2.0:1788836638.987265:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921344 00000100:00100000:2.0:1788836638.987279:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921728 00000100:00100000:2.0:1788836638.987282:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921728 00000100:00100000:2.0:1788836638.987289:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921856 00000100:00100000:2.0:1788836638.987291:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921856 00000100:00100000:2.0:1788836638.987326:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788836638.987334:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782921856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836638.987390:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875730782921856:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836638.987398:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788836638.987417:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788836638.987421:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921216:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788836638.987440:0:10333:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836638.987473:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921216:12345-0@lo:38:kworker.0 Request processed in 51us (805us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836638.987479:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788836638.987490:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788836638.987494:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921344:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788836638.987503:0:10333:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836638.987526:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921344:12345-0@lo:38:kworker.0 Request processed in 30us (552us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836638.987532:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788836638.987542:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788836638.987546:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921728:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788836638.987564:0:10333:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836638.987586:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782921728:12345-0@lo:38:kworker.0 Request processed in 38us (544us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836638.987592:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788836638.987613:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921600 00000100:00100000:2.0:1788836638.987617:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921600 00000100:00100000:2.0:1788836638.987642:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788836638.987661:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836638.987695:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782921600:12345-0@lo:400:kworker.0 Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836638.987702:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1788836638.987856:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836638.987892:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782921600:0@lo:400:kworker.0 00010000:00080000:2.0:1788836638.987906:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8adf7736b480 x1875730782921856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836638.987918:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782921856:0@lo:400:kworker.0 00000100:00080000:2.0:1788836638.987971:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836638.987977:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836638.987980:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782921216:0@lo:38:kworker.0 00000100:00080000:2.0:1788836638.987988:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836638.987992:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836638.987994:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782921344:0@lo:38:kworker.0 00000100:00080000:2.0:1788836638.988002:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836638.988005:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836638.988067:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782921728:0@lo:38:kworker.0 00000400:00000100:1.0:1788836638.995008:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730782921088 offset 0 length 224: 4 00000100:00100000:0.0:1788836638.995446:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782921984:0@lo:400:kworker.0 00000100:00100000:0.0:1788836638.995518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836638.995844:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921984 00000100:00100000:1.0:1788836638.995853:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921984 00000100:00100000:1.0:1788836638.995911:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788836638.995919:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782921984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836638.995991:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782921984:12345-0@lo:400:kworker.0 Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836638.995998:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1788836638.996042:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836638.996113:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782921984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836638.998677:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836639.001347:0:10333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782921472 00000100:00100000:2.0:1788836639.001363:0:10333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782921472 00000100:00100000:2.0:1788836639.001450:0:10333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788836639.001461:0:10333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782921472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836639.001557:0:10333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730782921472:12345-0@lo:400:kworker.0 Request processed in 98us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836639.001564:0:10333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00080000:3.0:1788836639.001955:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8adf77368700 x1875730782921472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836639.001972:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730782921472:0@lo:400:kworker.0 00000100:00080000:1.0:1788836639.003039:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788836639.105298:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836639.486159:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836639.486201:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782922112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836639.486299:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836639.486381:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782922112 00000100:00100000:0.0:1788836639.486389:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782922112 00000100:00100000:0.0:1788836639.486442:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788836639.486452:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782922112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836639.486491:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788836639.486537:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782922112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836639.486546:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788836639.486604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782922112:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836640.131152:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788836640.589938:0:15394:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788836640.616200:0:15394:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788836640.616253:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.616267:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.616275:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.616282:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.616308:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836640.616313:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788836640.616334:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836640.616339:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836640.616345:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836640.616350:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8adf65c60800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788836640.616355:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836640.616369:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788836640.616373:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836640.617258:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836640.617268:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836640.617278:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade438f7000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836640.617281:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836640.617291:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836640.617299:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836640.617305:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836640.617307:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836640.617310:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836640.617344:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836640.617363:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836640.617392:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836640.617399:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade438f7000/0xf7b38383a655400b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554012 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836640.617410:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836640.617412:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836640.617414:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836640.617432:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782922240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836640.617510:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836640.617585:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782922240 00000100:00100000:0.0:1788836640.617591:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782922240 00000100:00100000:0.0:1788836640.617642:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836640.617649:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875730782922240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788836640.617655:0:6475:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836640 with bad export cookie 17848754349653965522 00010000:00010000:2.0:1788836640.618346:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618356:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618363:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618369:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618390:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836640.618396:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618402:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618407:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618413:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618423:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836640.618428:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618452:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618457:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.618463:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.620966:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788836640.620987:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.620999:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.621006:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.621025:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836640.621038:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788836640.621042:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788836640.621081:0:15394:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788836640.621085:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788836640.621090:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836640.621096:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788836640.621103:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ade42b75000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836640.621123:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ade4252c800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836640.621128:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8adf72c319b8) has exports, disconnecting them 00000020:00080000:2.0:1788836640.621132:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ade42b75000), last request at 1788836638 00000020:00000080:2.0:1788836640.621140:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553eb4 00000100:00080000:2.0:1788836640.621159:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8ade42b75800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788836640.621213:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade42b75000): rc 0 00000020:00000080:2.0:1788836640.621216:0:15394:0:(genops.c:885:class_export_put()) final put ffff8ade42b75000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1788836640.622384:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788836640.622396:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622405:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836640.622409:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622419:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836640.622426:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836640.622431:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836640.622434:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788836640.622437:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788836640.622491:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622498:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836640.622525:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622532:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701400/0xf7b38383a6554020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6554027 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622560:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788836640.622564:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622569:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836640.622572:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622579:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836640.622585:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836640.622590:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836640.622593:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788836640.622595:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788836640.622610:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622616:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836640.622646:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622653:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf40031a00/0xf7b38383a6553eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553ef3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622668:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836640.622671:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622683:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46c00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836640.622686:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622693:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836640.622699:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836640.622704:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788836640.622706:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788836640.622708:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788836640.622720:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622726:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836640.622732:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622751:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f46c00/0xf7b38383a6554288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a655428f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622760:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836640.622764:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622770:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf82173400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836640.622773:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622785:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836640.622791:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836640.622809:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836640.622812:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788836640.622813:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788836640.622825:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622831:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836640.622837:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622844:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf82173400/0xf7b38383a6553bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7b38383a6553bdc expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836640.622855:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836640.622856:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836640.622858:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836640.622867:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836640.622887:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782922496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836640.622955:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836640.623029:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836640.623036:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782922624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836640.623059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836640.623095:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782922496 00000100:00100000:3.0:1788836640.623108:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782922496 00000100:00100000:3.0:1788836640.623140:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782922624 00000100:00100000:3.0:1788836640.623143:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782922624 00000100:00100000:3.0:1788836640.623156:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836640.623163:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1875730782922496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788836640.623170:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836640 with bad export cookie 17848754349653965522 00000100:00100000:3.0:1788836640.623217:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1875730782922496:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (261us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788836640.623224:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836640.623238:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836640.623242:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1875730782922624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788836640.623246:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836640 with bad export cookie 17848754349653965522 00000100:00100000:3.0:1788836640.623267:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3616:x1875730782922624:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (207us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788836640.623272:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788836640.623297:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788836640.623301:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8adf4395a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788836640.623305:0:3616:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:2.0:1788836640.635095:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ade4252c800), last request at 1788836639 00000020:00000080:2.0:1788836640.635107:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d8e 00000100:00080000:2.0:1788836640.635119:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8ade4252e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788836640.635151:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade4252c800): rc 0 00000020:00000080:2.0:1788836640.635153:0:15394:0:(genops.c:885:class_export_put()) final put ffff8ade4252c800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788836640.635163:0:15394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb2ab01477ae0 00000100:00080000:2.0:1788836640.635186:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836640.635196:0:15394:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8ade44551180 x1875730782920832/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788836654 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836640.635207:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1788836640.640348:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b75000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788836640.640414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788836640.640461:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b75800 for lustre-MDT0001 00000020:00000080:1.0:1788836640.640466:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade4252e000 for lustre-MDT0001 00000040:00080000:2.0:1788836640.645592:0:13787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788836640.645690:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836640.645698:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8adf77de1000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788836640.645817:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788836640.645822:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788836640.645835:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788836640.645920:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788836640.645944:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8adf7fb58000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788836640.645959:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788836640.645962:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788836640.645987:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836640.646080:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782922880:0@lo:9:umount.0 00000100:00100000:2.0:1788836640.646154:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836640.646210:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782922880 00000100:00100000:2.0:1788836640.646217:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782922880 00000100:00100000:2.0:1788836640.646272:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788836640.646282:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1875730782922880:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836640.646306:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553ddb 00000100:00080000:2.0:1788836640.646315:0:8407:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836640.646350:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788836640.646481:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3613:x1875730782922880:12345-0@lo:9:umount.0 Request processed in 200us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836640.646490:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788836640.646508:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836640.646538:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7fb58000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836640.646546:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836640.646548:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836640.646551:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782922880:0@lo:9:umount.0 00000100:00080000:2.0:1788836640.646572:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788836640.646582:0:15394:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788836640.646597:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782923008:0@lo:9:umount.0 00000100:00100000:2.0:1788836640.646636:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836640.646664:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782923008 00000100:00100000:2.0:1788836640.646668:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782923008 00000100:00100000:2.0:1788836640.646696:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836640.646701:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1875730782923008:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836640.646713:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f1d 00000100:00080000:2.0:1788836640.646726:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8adf8145f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836640.646743:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788836640.646825:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3613:x1875730782923008:12345-0@lo:9:umount.0 Request processed in 123us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836640.646832:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788836640.646845:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836640.646862:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade42b5e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836640.646870:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836640.646872:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836640.646875:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782923008:0@lo:9:umount.0 00000020:00080000:2.0:1788836640.646912:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8adf72c319b8) has no exports 00010000:00010000:2.0:1788836640.655988:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836640.660107:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836640.670903:0:3616:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.138@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788836640.670908:0:3616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788836640.670917:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf77369880 x1875730782921088/t0(0) o400->MGC192.168.201.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788836654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836640.670933:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade44709f80 x1875730782922240/t0(0) o103->MGC192.168.201.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836656 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836640.670942:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf7736a300 x1875730782922496/t0(0) o103->MGC192.168.201.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836656 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836640.670952:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf77369f80 x1875730782922624/t0(0) o103->MGC192.168.201.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836656 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788836640.671377:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788836640.671382:0:3616:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788836640.671383:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1788836640.672151:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836640.673705:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:0:1875730782922752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836640.673771:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3614:1875730782922240:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1788836640.673859:0:6475:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875730782922240 offset 224 length 224: 4 00000100:00100000:1.0:1788836640.673883:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875730782922240:12345-0@lo:103:ldlm_bl.0 Request processed in 56233us (56373us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836640.673894:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836640.683730:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:0:1875730782922368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836640.683767:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782920832:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788836640.692267:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8adf4395a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836640.692281:0:3616:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 142 00000100:00080000:3.0:1788836640.692292:0:3616:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff8adf4395a000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836640.692365:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77369180 x1875730782923136/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836640.692423:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782922496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836640.692434:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782921088:0@lo:400:kworker.0 00000100:00100000:3.0:1788836640.692464:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3616:1875730782922624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836640.692664:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782923136:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788836640.692719:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730782923136 offset 0 length 520: 4 00000020:00080000:1.0:1788836640.710300:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8adf72c319b8) has no exports 00000020:01000000:0.0:1788836640.837178:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ade425a4540 - data ffff8adf6cf41a20/ffff8ade437e9400 00000020:01000000:0.0:1788836640.837344:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adf80922d20 - data ffff8adf6cd0a000/ffff8adf77f4a800 00000001:00000004:1.0:1788836640.869196:0:15394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788836640.963220:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836640.963230:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788836640.963239:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788836640.970370:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836640.970379:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788836640.970397:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836640.970399:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788836640.972183:0:8486:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788836640.972192:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788836640.972223:0:8486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788836640.973068:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836640.973074:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788836640.973088:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836640.973090:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836640.973548:0:10017:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836640.973552:0:10017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788836640.973574:0:10017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788836640.974979:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553bf8 00000020:00000080:3.0:1788836640.974990:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf80945800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836640.975581:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80945800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788836640.989921:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c0d 00000020:00000080:3.0:1788836640.989937:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf80940800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788836640.989954:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788836640.989972:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836640.989982:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788836640.989986:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8adf72c33370) has no exports 00000004:01000000:3.0:1788836640.990195:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788836640.990204:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f16 00000020:00000080:3.0:1788836640.990209:0:15394:0:(genops.c:885:class_export_put()) final put ffff8ade42b59800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788836640.990214:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788836640.990217:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836640.990224:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836640.990227:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8adf7fb84d28) has no exports 00000020:00000080:3.0:1788836640.990233:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553f0f 00000020:00000080:3.0:1788836640.990237:0:15394:0:(genops.c:885:class_export_put()) final put ffff8ade42b59000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788836640.990591:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788836640.990597:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000020:00000080:0.0:1788836640.990599:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80940800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000100:00100000:3.0:1788836640.990601:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788836640.990607:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788836640.990607:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b59800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000100:00100000:3.0:1788836640.990609:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836640.990621:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b59000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788836640.991548:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836640.991551:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b5e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788836640.991560:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836640.991565:0:15394:0:(genops.c:885:class_export_put()) final put ffff8ade42b5d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836640.991567:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b5d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788836640.991574:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836640.991665:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553dd4 00000020:00000080:3.0:1788836640.991672:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf7a763000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788836640.991687:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788836640.991692:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836640.991697:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836640.991700:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8adf817b3370) has no exports 00000020:00000080:3.0:1788836640.991706:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553dcd 00000020:00000080:3.0:1788836640.991709:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf7fb5e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836640.992195:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a763000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788836640.992203:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fb5e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788836640.993893:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788836640.993900:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836640.993913:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788836640.993921:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836640.993923:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836640.993974:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836640.993984:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788836640.993999:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788836640.994006:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c30 00000020:00000080:3.0:1788836640.994030:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf77f56800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788836640.994037:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788836640.994041:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836640.994045:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836640.994049:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8adf7713cd28) has no exports 00000020:00000080:3.0:1788836640.994055:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c29 00000020:00000080:3.0:1788836640.994058:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf77de0000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836640.994111:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7fb58000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788836640.994118:0:13965:0:(genops.c:885:class_export_put()) final put ffff8adf7a762000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836640.994121:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a762000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788836640.994126:0:13965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836640.994191:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77f56800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788836640.994196:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77de0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788836641.003392:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788836641.003401:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836641.003406:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788836641.003417:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836641.003589:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836641.003610:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788836641.003652:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836641.003656:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788836641.003663:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf44824000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788836641.003668:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44824000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788836641.003678:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788836641.003833:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c14 00000020:00000080:1.0:1788836641.003849:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf80941000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788836641.003854:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788836641.003858:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836641.003862:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788836641.003865:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8adf72c34d28) has no exports 00000020:00000080:1.0:1788836641.003882:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836641.003884:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788836641.003889:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c1b 00000020:00000080:1.0:1788836641.003902:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf80940000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788836641.003909:0:15394:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf444f2000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788836641.003912:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf444f2000 2 00000020:01000004:1.0:1788836641.003915:0:15394:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adf444f2000 from lustre-MDT0001 00000020:00000080:1.0:1788836641.003936:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836641.003939:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788836641.003942:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf80945000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788836641.003944:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80945000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788836641.003950:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788836641.003977:0:15394:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788836641.003981:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788836641.003983:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836641.003986:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788836641.003992:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8adf44483000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788836641.003997:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8adf48a1b370) has exports, disconnecting them 00000020:00080000:1.0:1788836641.004001:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8adf44483000), last request at 1788836382 00000020:00000080:1.0:1788836641.004005:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553c6f 00000020:00080000:1.0:1788836641.004033:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf44483000): rc 0 00000020:00000080:1.0:1788836641.004037:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf44483000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788836641.007299:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf77de1000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788836641.007318:0:13965:0:(genops.c:885:class_export_put()) final put ffff8adf77de3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836641.007322:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77de3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788836641.007336:0:13965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836641.007506:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80941000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788836641.007511:0:13965:0:(genops.c:885:class_export_put()) final put ffff8adf80947000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788836641.007513:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80947000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788836641.007517:0:13965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788836641.007729:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf80940000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788836641.007745:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44483000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788836641.007784:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788836641.007788:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836641.007792:0:15394:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836641.007798:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836641.007824:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf65c60800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788836641.008000:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836641.008009:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788836641.008032:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf772f9800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788836641.008034:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf772f9800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788836641.008038:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788836641.008069:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf444f2000 1 00000020:00000080:0.0:1788836641.008075:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553bab 00000020:00000080:0.0:1788836641.008082:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf65c84000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788836641.008089:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788836641.008098:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf65c84000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788836641.008106:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836641.008111:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836641.008114:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8adf72c30000) has no exports 00010000:00010000:2.0:1788836641.180049:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836641.207340:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836641.207353:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788836641.207359:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf444f7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788836641.207365:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf444f7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788836641.207375:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788836641.207583:0:15394:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adf444f3000 00000020:01000000:1.0:1788836641.207617:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788836641.207621:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836641.207625:0:15394:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836641.207633:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8adf48a18000) has no exports 00000100:00100000:2.0:1788836641.207810:0:12185:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff8adf773eb400:12185] 5 exiting: rc = 0 00000100:00100000:0.0:1788836641.207816:0:6490:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8adf42c5f600:6490] 0 exiting: rc = 1 00000100:00100000:2.0:1788836641.207927:0:10333:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8adf817a9000:10333] 3 exiting: rc = 0 00000100:00100000:2.0:1788836641.207996:0:10681:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8adf540fc000:10681] 4 exiting: rc = 0 00000100:00100000:3.0:1788836641.208181:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8adf42c5f400:6492] 2 exiting: rc = 0 00000100:00100000:3.0:1788836641.208280:0:6491:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8adf72f11400:6491] 1 exiting: rc = 0 00000100:00100000:1.0:1788836641.208387:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208395:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208412:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208418:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208423:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208430:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208437:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208443:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208448:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208454:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208460:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208830:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208836:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208842:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208847:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208852:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208857:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208863:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208868:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208873:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208879:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208884:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208889:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208894:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208899:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208904:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208909:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208914:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208918:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208923:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208928:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208933:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208938:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208943:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208948:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208954:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.208959:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209208:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209215:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209220:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209224:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209229:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209234:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209239:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209244:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209249:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209254:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209259:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209264:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209269:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209274:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209279:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209283:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209288:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209292:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209297:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209302:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209307:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209312:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209317:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209322:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209332:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209339:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.209388:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836641.213000:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8adf4972c000:6493] 0 exiting: rc = 1 00000100:00100000:0.0:1788836641.215203:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8adf442a8200:6494] 1 exiting: rc = 0 00000100:00100000:1.0:1788836641.215428:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215438:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215445:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215452:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215459:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215533:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215540:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215545:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215565:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215571:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215577:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215583:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215590:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215596:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215601:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215606:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215622:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215628:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215634:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215639:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215644:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215649:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215655:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215660:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215665:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215671:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215676:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215681:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215687:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215692:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215697:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215703:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215708:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215713:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215718:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215723:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215728:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215733:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215739:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215744:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215749:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215754:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215759:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215771:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215777:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215782:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215787:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215792:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215797:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215802:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215807:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215813:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215819:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215825:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215830:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215836:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215841:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215847:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215853:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215858:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215863:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215868:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215874:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.215879:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836641.217461:0:7800:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8adf7a4b8400:7800] 2 exiting: rc = 0 00000100:00100000:2.0:1788836641.218841:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8adf42ba6000:6495] 0 exiting: rc = 1 00000100:00100000:0.0:1788836641.219585:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8adf442a9000:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1788836641.219754:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219765:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219772:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219779:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219786:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219793:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219800:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219806:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219813:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219820:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219826:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219833:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219839:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219864:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219883:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219890:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219897:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219903:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219909:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219919:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219925:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219932:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219938:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219944:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219949:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219980:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219988:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.219994:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220001:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220006:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220176:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220184:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220190:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220196:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220202:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220209:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220215:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220236:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220247:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220252:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220258:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220267:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220277:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220283:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220290:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220295:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220301:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220319:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220325:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220356:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220363:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220372:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220379:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220384:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220389:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220395:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220401:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220408:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220415:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220421:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220427:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220435:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220443:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.220456:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836641.229916:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8adf50b74e00:6497] 0 exiting: rc = 1 00000100:00100000:2.0:1788836641.230292:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8adf50b75600:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1788836641.230692:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230700:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230705:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230710:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230716:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230721:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230727:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230733:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230752:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230758:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230763:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230769:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230774:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230780:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230786:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230791:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230797:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230802:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230808:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230813:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230818:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230823:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230829:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230834:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230840:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230845:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230851:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230857:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230863:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230868:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230874:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230879:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230885:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230890:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230897:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230901:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230907:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230912:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230918:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230924:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230930:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230935:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230941:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230954:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230959:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230965:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.230971:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231276:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231286:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231292:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231297:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231303:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231310:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231316:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231323:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231328:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231334:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231339:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231344:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231350:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231355:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231361:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231367:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231372:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231783:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8adf50b74000:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1788836641.231868:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8adf4399d000:6500] 1 exiting: rc = 0 00000100:00100000:0.0:1788836641.231915:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231922:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231927:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231933:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231938:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231944:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231950:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231955:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231961:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231977:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231984:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.231989:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232004:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232009:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232031:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232209:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232215:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232220:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232225:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232231:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232236:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232242:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232247:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232253:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232258:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232264:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232269:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232274:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232280:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232285:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232290:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232296:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232301:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232306:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232311:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232317:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232323:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232328:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232334:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232339:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232345:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232350:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232356:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232361:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232368:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232373:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232378:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232390:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232395:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232400:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232406:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232411:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232416:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232421:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232426:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232431:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232436:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232441:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232446:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232451:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232455:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232754:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232762:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.232768:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.233724:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8adf65cabc00:6502] 1 exiting: rc = 0 00000100:00100000:1.0:1788836641.233817:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8adf65caae00:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1788836641.234514:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234522:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234527:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234532:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234538:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234543:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234549:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234554:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234559:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234565:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234570:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234577:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234581:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234586:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234590:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234595:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234601:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234606:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234634:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234640:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234644:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234649:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234654:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234658:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234663:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234667:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234672:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234676:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234681:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234686:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234692:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234696:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234701:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234705:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234710:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234715:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234720:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234724:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234729:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234734:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234739:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234743:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234748:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234752:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234757:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234762:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234767:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234772:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234777:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234782:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234787:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234792:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234796:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234808:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234813:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234819:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234824:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234829:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234834:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234839:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234844:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234849:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234854:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.234859:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836641.236230:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8adf65cabe00:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1788836641.236538:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8adf65cab800:6505] 2 exiting: rc = 0 00000100:00100000:0.0:1788836641.236808:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8adf65cab400:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1788836641.236870:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236877:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236883:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236910:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236918:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236924:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236931:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236937:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236942:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236948:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236954:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236961:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236980:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236988:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.236994:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237000:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237006:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237181:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237192:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237198:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237204:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237210:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237215:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237231:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237237:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237242:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237248:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237267:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237274:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237279:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237285:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237290:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237296:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237301:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237307:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237312:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237318:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237323:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237329:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237334:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237340:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237346:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237353:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237358:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237365:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237371:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237377:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237383:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237389:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237396:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237403:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237422:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237429:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237434:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237440:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237446:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237451:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237456:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237535:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237541:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237548:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237553:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237559:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836641.237565:0:15394:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788836641.242953:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836641.243139:0:15394:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788836641.243146:0:15394:0:(genops.c:885:class_export_put()) final put ffff8adf65c85000/MDS_uuid 00000020:00000080:0.0:1788836641.243151:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf65c85000/MDS_uuid for MDS 00000020:01000000:0.0:1788836641.243157:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788836641.243309:0:15394:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788836642.241438:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836643.263982:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836644.094385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836644.094393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836644.094396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836644.094400:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788836644.094403:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836644.094411:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 422 00000100:00080000:0.0:1788836644.094416:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788836644.094424:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ade41e65800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836644.094467:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44709180 x1875730782923264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836644.094532:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836644.094536:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788836644.094538:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836644.094543:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 422 00000100:00080000:0.0:1788836644.094546:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788836644.094549:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adf8145b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836644.094588:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade4470b800 x1875730782923520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836644.094625:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836644.094641:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782923648:0@lo:400:kworker.0 00000400:00000100:0.0:1788836644.094697:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923648 offset 0 length 224: 4 00000100:00100000:2.0:1788836644.094816:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782923264:0@lo:38:kworker.0 00000400:00000100:2.0:1788836644.094841:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923264 offset 0 length 520: 4 00000100:00100000:2.0:1788836644.094863:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782923520:0@lo:38:kworker.0 00000400:00000100:2.0:1788836644.094878:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923520 offset 0 length 520: 4 00000100:00100000:3.0:1788836644.094943:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836644.094955:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782923392:0@lo:400:kworker.0 00000400:00000100:3.0:1788836644.094981:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923392 offset 0 length 224: 4 00010000:00010000:3.0:1788836644.286189:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836645.310274:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836645.708924:0:15595:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788836645.732512:0:15595:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788836645.732609:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.732626:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.732634:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.732643:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.732670:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836645.732675:0:15595:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788836645.732702:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836645.732716:0:15595:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade44709180 x1875730782923264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836645.732734:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836645.732769:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836645.732775:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788836645.732780:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782923264:0@lo:38:kworker.0 00000100:00080000:2.0:1788836645.732825:0:15595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836645.732831:0:15595:0:(import.c:65:import_set_state_nolock()) ffff8ade41e65800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788836645.732836:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836645.732838:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788836645.732841:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788836645.733603:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788836645.733613:0:15595:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade44709500 x1875730782923392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836660 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836645.733655:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836645.733661:0:15595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788836645.733681:0:15595:0:(import.c:65:import_set_state_nolock()) ffff8ade4252a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788836645.733710:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782923776:0@lo:39:umount.0 00000400:00000100:2.0:1788836645.733759:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923776 offset 0 length 224: 4 00010000:00010000:0.0:1788836645.735621:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836645.735633:0:10309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.735656:0:10309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836645.735660:0:10309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.735671:0:10309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836645.735678:0:10309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836645.735684:0:10309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836645.735686:0:10309:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836645.735690:0:10309:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836645.735707:0:10309:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:0.0:1788836645.735711:0:10309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.735718:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43992200/0xf7b38383a6553fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553ff6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.735754:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836645.735756:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836645.735758:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836645.736282:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782923392:0@lo:400:kworker.0 00000100:00080000:1.0:1788836646.142914:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836646.142922:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836646.142925:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836646.142928:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836646.143064:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782923904:0@lo:400:kworker.0 00000400:00000100:0.0:1788836646.143126:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782923904 offset 0 length 224: 4 00000001:00100000:1.0:1788836646.150894:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788836646.150907:0:9483:0:(genops.c:885:class_export_put()) final put ffff8adf8145a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788836646.151086:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf8145a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788836646.151205:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf8145f800 for lustre-OST0001 00000001:00100000:2.0:1788836646.151463:0:8401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788836646.151468:0:8401:0:(genops.c:885:class_export_put()) final put ffff8adf7a4a5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788836646.151516:0:13965:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a4a5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788836646.151564:0:13965:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf7a4a6800 for lustre-OST0000 00010000:00010000:3.0:1788836646.334769:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836647.358257:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836648.190192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836648.190202:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836648.190205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836648.190208:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836648.190347:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782924032:0@lo:400:kworker.0 00000400:00000100:0.0:1788836648.190411:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782924032 offset 0 length 224: 4 00010000:00010000:0.0:1788836648.388066:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836649.406229:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836650.430276:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836650.878173:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836640/real 1788836640] req@ffff8adf77369180 x1875730782923136/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836650.878208:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adf77369180 x1875730782923136/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836650.878229:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf4395a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836650.878252:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788836650.878256:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782923136:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788836650.878295:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836650.878302:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788836650.878305:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf4395a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836650.878310:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 424 00000100:00080000:3.0:1788836650.878335:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836650.878341:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff8adf4395a000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836650.878375:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77369f80 x1875730782924160/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836650.878400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836650.878405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836650.878435:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782924160:0@lo:250:kworker.0 00000400:00000100:2.0:1788836650.878492:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730782924160 offset 0 length 520: 4 00000100:00100000:1.0:1788836650.878499:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782924288:0@lo:400:kworker.0 00000400:00000100:1.0:1788836650.878539:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782924288 offset 0 length 224: 4 00010000:00010000:0.0:1788836651.454827:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836652.479180:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836653.503236:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836654.526141:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836655.555323:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836655.998850:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836645/real 1788836645] req@ffff8ade445e1500 x1875730782923776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836655.998882:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e1500 x1875730782923776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836655.998902:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade4252a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788836655.998926:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782923776:0@lo:39:umount.0 00000100:00080000:0.0:1788836656.000965:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788836656.000974:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788836656.000981:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836656.002233:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002251:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002258:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002264:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002366:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.002375:0:15595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002381:0:15595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002396:0:15595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.002404:0:15595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014056:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836656.014072:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014085:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836656.014089:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014101:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836656.014108:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836656.014114:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836656.014118:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788836656.014148:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:1.0:1788836656.014152:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014159:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6553ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554004 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014182:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.014186:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014192:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836656.014215:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014222:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836656.014229:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836656.014234:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788836656.014236:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788836656.014241:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:1.0:1788836656.014244:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.014251:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.014253:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.014255:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.031538:0:15595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788836656.031555:0:15595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf77f47000/0xf7b38383a655427a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554281 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836656.031576:0:15595:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788836656.031585:0:15595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788836656.031587:0:15595:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788836656.031622:0:15595:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788836656.031627:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788836656.031649:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836656.031655:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836656.031658:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8adf48a199b8) has no exports 00000020:00080000:0.0:1788836656.031683:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8adf48a199b8) has no exports 00000020:01000000:0.0:1788836656.033321:0:15595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ade4356e2a0 - data ffff8adf6cf40288/ffff8ade424eb800 00000020:01000000:0.0:1788836656.033450:0:15595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adf7a4d2360 - data ffff8adf6ce78360/ffff8ade42513000 00010000:00010000:2.0:1788836656.033818:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788836656.055523:0:15595:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788836656.086053:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d48 00000020:00000080:2.0:1788836656.086065:0:15595:0:(genops.c:885:class_export_put()) final put ffff8adf7a4a5800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788836656.086079:0:15595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7a54e000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788836656.086082:0:15595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7a54e000 2 00000020:01000004:2.0:1788836656.086086:0:15595:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adf7a54e000 from lustre-OST0000 00000020:00000080:2.0:1788836656.086108:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836656.086118:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788836656.086120:0:15595:0:(genops.c:885:class_export_put()) final put ffff8adf7a4a2800/lustre-OST0000_UUID 00000020:00000080:2.0:1788836656.086123:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a4a2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788836656.086129:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788836656.086197:0:15595:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788836656.086202:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788836656.086206:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836656.086211:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836656.086217:0:15595:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ade41e64000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836656.086223:0:15595:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8ade42544d28) has exports, disconnecting them 00000020:00080000:2.0:1788836656.086228:0:15595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ade41e64000), last request at 1788836405 00000020:00000080:2.0:1788836656.086231:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d72 00000020:00080000:2.0:1788836656.086240:0:15595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade41e64000): rc 0 00000020:00000080:2.0:1788836656.086245:0:15595:0:(genops.c:885:class_export_put()) final put ffff8ade41e64000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788836656.086992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a4a5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788836656.087009:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade41e64000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788836656.094233:0:15595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788836656.094242:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788836656.094246:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788836656.094253:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836656.094441:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836656.094452:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788836656.094458:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788836656.094464:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836656.094467:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788836656.094475:0:15595:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ade4252f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788836656.094481:0:15595:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8adf442a19b8) has exports, disconnecting them 00000020:00080000:1.0:1788836656.094486:0:15595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ade4252f000), last request at 1788836405 00000020:00000080:1.0:1788836656.094501:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d87 00000020:00080000:1.0:1788836656.094516:0:15595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade4252f000): rc 0 00000020:00000080:1.0:1788836656.094521:0:15595:0:(genops.c:885:class_export_put()) final put ffff8ade4252f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788836656.095484:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade41e65800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788836656.095495:0:36:0:(genops.c:885:class_export_put()) final put ffff8ade41e66800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788836656.095498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade41e66800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788836656.095504:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788836656.095561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788836656.095586:0:15595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788836656.095590:0:15595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788836656.095593:0:15595:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836656.095598:0:15595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836656.095614:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade4252a000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788836656.095761:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836656.095767:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788836656.095771:0:15595:0:(genops.c:885:class_export_put()) final put ffff8ade42529800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788836656.095773:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42529800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788836656.095787:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788836656.095816:0:15595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7a54e000 1 00000020:00000080:0.0:1788836656.095822:0:15595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553d10 00000020:00000080:0.0:1788836656.095827:0:15595:0:(genops.c:885:class_export_put()) final put ffff8adf77f53800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788836656.095835:0:15595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788836656.095842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77f53800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788836656.095851:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836656.095856:0:15595:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836656.095859:0:15595:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8adf77138000) has no exports 00000020:00000080:0.0:1788836656.292476:0:15595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836656.292490:0:15595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788836656.292496:0:15595:0:(genops.c:885:class_export_put()) final put ffff8adf7a548800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788836656.292501:0:15595:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7a548800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788836656.292522:0:15595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788836656.292896:0:15595:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adf7a54f000 00000020:02000400:0.0:1788836656.292959:0:15595:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788836656.387028:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836656.387037:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836656.387041:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836656.387043:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836656.387105:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836656.387119:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782924416:0@lo:400:kworker.0 00000400:00000100:0.0:1788836656.387167:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782924416 offset 0 length 224: 4 00010000:00010000:1.0:1788836656.586742:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836657.599108:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836658.624510:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836659.653697:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788836660.481116:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836644/real 1788836644] req@ffff8ade44709c00 x1875730782923648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836660.506368:0:3617:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ade44709c00 x1875730782923648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836660 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836660.506383:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ade42b73800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788836660.506386:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788836660.521490:0:3617:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788836660.521541:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782923648:0@lo:400:kworker.0 00000100:00080000:3.0:1788836660.521676:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836660.521681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836660.521684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836660.521687:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836660.521690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836660.521693:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788836660.521697:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ade42b73800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836660.521702:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:3.0:1788836660.521711:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ade42b73800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836660.521747:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7736a300 x1875730782924544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836660.521828:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782924544:0@lo:38:kworker.0 00000400:00000100:0.0:1788836660.521889:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730782924544 offset 0 length 520: 4 00010000:00010000:1.0:1788836660.677784:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788836660.921597:0:15797:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788836660.931791:0:15797:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788836660.931879:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.931896:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.931903:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.931909:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.931935:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788836660.931940:0:15797:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788836660.931963:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788836660.931974:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade4470b800 x1875730782923520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.931995:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788836660.932001:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788836660.932007:0:15797:0:(import.c:65:import_set_state_nolock()) ffff8adf8145b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788836660.932031:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788836660.932046:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade4470b800 x1875730782923520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836664 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.932053:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788836660.932056:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:2.0:1788836660.932811:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836660.932820:0:10309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836660.932828:0:10309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993600 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:2.0:1788836660.932832:0:10309:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836660.932841:0:10309:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836660.932848:0:10309:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836660.932855:0:10309:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836660.932857:0:10309:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788836660.932860:0:10309:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788836660.932874:0:10309:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:2.0:1788836660.932878:0:10309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836660.932886:0:10309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43993600/0xf7b38383a6553fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553fd3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836660.932897:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836660.932899:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836660.932900:0:10309:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836660.933919:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782923520:0@lo:38:kworker.0 00000100:00080000:1.0:1788836660.935803:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836660.935819:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade428d8a80 x1875730782923904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935846:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade445e3800 x1875730782924032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935906:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf77369880 x1875730782924288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935928:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade44709500 x1875730782924416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935936:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf7736a300 x1875730782924544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836670 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935947:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788836660.935953:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788836660.935959:0:15797:0:(import.c:65:import_set_state_nolock()) ffff8ade42b73800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788836660.935964:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836660.935967:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade428d8a80 x1875730782923904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836662 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.935975:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade445e3800 x1875730782924032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836664 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836660.936061:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875730782924288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836660.936118:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782924416:0@lo:400:kworker.0 00000100:00100000:2.0:1788836660.936291:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782924032:0@lo:400:kworker.0 00000100:00100000:1.0:1788836660.936321:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf77369880 x1875730782924288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.936330:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ade44709500 x1875730782924416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.936350:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf7736a300 x1875730782924544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836670 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836660.936357:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788836660.936438:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782923904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836660.936467:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782924544:0@lo:38:kworker.0 00000100:00100000:1.0:1788836660.936546:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788836660.937712:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937727:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937735:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937742:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937802:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836660.937812:0:15797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937820:0:15797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937826:0:15797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.937832:0:15797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.937908:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836660.937915:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.937930:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993c00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836660.937934:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.937942:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836660.937948:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836660.937954:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836660.937956:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788836660.937968:0:6477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:3.0:1788836660.937971:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.937977:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43993c00/0xf7b38383a6553fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553fe8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.937991:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836660.937994:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.938000:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836660.938003:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.938098:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836660.938111:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836660.938117:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788836660.938119:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788836660.938124:0:6477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:3.0:1788836660.938127:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836660.938134:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836660.938135:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836660.938137:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836660.938283:0:15797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836660.938289:0:15797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a655426c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554273 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836660.938303:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788836660.938307:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788836660.938309:0:15797:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788836660.938337:0:15797:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788836660.938342:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788836660.938347:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836660.938353:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836660.938357:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8adf817b19b8) has no exports 00000020:00080000:1.0:1788836660.938382:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8adf817b19b8) has no exports 00010000:00010000:2.0:1788836660.943096:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788836660.943811:0:15797:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adf42ac2420 - data ffff8adf6cf40870/ffff8ade424e9400 00000020:01000000:1.0:1788836660.943970:0:15797:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ade4356ede0 - data ffff8adf6cf39d80/ffff8adf7fbe7800 00100000:10000000:0.0:1788836660.967591:0:15797:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788836660.986732:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e6e 00000020:00000080:1.0:1788836660.986745:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf8145e800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788836660.986771:0:15797:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf7fbb1000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788836660.986775:0:15797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7fbb1000 2 00000020:01000004:1.0:1788836660.986778:0:15797:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adf7fbb1000 from lustre-OST0001 00000020:00000080:1.0:1788836660.986800:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836660.986811:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788836660.986814:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf8145f000/lustre-OST0001_UUID 00000020:00000080:1.0:1788836660.986817:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf8145f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788836660.986824:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788836660.986951:0:15797:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb->MGS 00010000:00010000:1.0:1788836660.986967:0:15797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf82172a00/0xf7b38383a6553bc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836660.986979:0:15797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf82172a00/0xf7b38383a6553bc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836660.986996:0:15797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788836660.986999:0:15797:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788836660.987003:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788836660.987053:0:15797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:1.0:1788836660.987067:0:15797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf82172a00/0xf7b38383a6553bc7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6553bce expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836660.987083:0:15797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836660.987091:0:15797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836660.987096:0:15797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836660.987098:0:15797:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788836660.987100:0:15797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788836660.987116:0:15797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adf4395a000 00010000:00010000:1.0:1788836660.987120:0:15797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a655404a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7b38383a6554051 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788836660.987135:0:15797:0:(import.c:65:import_set_state_nolock()) ffff8adf4395a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788836660.987139:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788836660.987141:0:15797:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788836660.987142:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788836660.987146:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788836660.987155:0:15797:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adf77369f80 x1875730782924160/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788836665 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1788836660.987379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf8145e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1788836660.987516:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788836660.987519:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:2.0:1788836660.987578:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93ab2035-a4dd-4f27-b6c0-c2e00fd962fb:3613:1875730782924160:0@lo:250:kworker.0 10000000:01000000:1.0:1788836660.987836:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788836660.987851:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553ac4 00000020:00000080:1.0:1788836660.987857:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf433d6800/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb 00000020:01000000:1.0:1788836660.987870:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.138@tcp (flags='') 00000020:00000080:1.0:1788836660.987875:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836660.987880:0:15797:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836660.987884:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8adf48a1cd28) has no exports 10000000:01000000:3.0:1788836660.987941:0:6487:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1788836660.988044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf433d6800/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb for MGC192.168.201.138@tcp 10000000:01000000:1.0:1788836660.988291:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.138@tcp: client import never connected 00000100:00080000:1.0:1788836660.988294:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788836660.988296:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788836660.988298:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788836660.988300:0:15797:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788836660.988342:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836660.988347:0:15797:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.138@tcp (uuid 93ab2035-a4dd-4f27-b6c0-c2e00fd962fb) 00000020:01000000:1.0:1788836660.988354:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788836660.988358:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836660.988361:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788836660.988366:0:15797:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8adf81459800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788836660.988371:0:15797:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8adf817b4d28) has exports, disconnecting them 00000020:00080000:1.0:1788836660.988376:0:15797:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8adf81459800), last request at 1788836429 00000020:00000080:1.0:1788836660.988380:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e98 00000020:00080000:1.0:1788836660.988392:0:15797:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adf81459800): rc 0 00000020:00000080:1.0:1788836660.988396:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf81459800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788836660.989406:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf4395a000 for MGC192.168.201.138@tcp 00000020:00000080:2.0:1788836660.989417:0:36:0:(genops.c:885:class_export_put()) final put ffff8adf44e24800/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb 00000020:00000080:2.0:1788836660.989420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf44e24800/93ab2035-a4dd-4f27-b6c0-c2e00fd962fb for MGC192.168.201.138@tcp 00000020:01000000:2.0:1788836660.989426:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.138@tcp (93ab2035-a4dd-4f27-b6c0-c2e00fd962fb) 00000020:00000080:2.0:1788836660.989732:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf81459800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788836660.997117:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788836660.997126:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836660.997130:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836660.997138:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836660.997374:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836660.997384:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788836660.997392:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788836660.997400:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836660.997404:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836660.997412:0:15797:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ade42b71800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836660.997419:0:15797:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8ade437019b8) has exports, disconnecting them 00000020:00080000:2.0:1788836660.997424:0:15797:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ade42b71800), last request at 1788836429 00000020:00000080:2.0:1788836660.997429:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553ead 00000020:00080000:2.0:1788836660.997447:0:15797:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ade42b71800): rc 0 00000020:00000080:2.0:1788836660.997453:0:15797:0:(genops.c:885:class_export_put()) final put ffff8ade42b71800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788836660.998258:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adf8145b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788836660.998278:0:36:0:(genops.c:885:class_export_put()) final put ffff8adf8145b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788836660.998282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf8145b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788836660.998294:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788836660.998362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b71800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788836661.000224:0:15797:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788836661.000231:0:15797:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788836661.000235:0:15797:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788836661.000241:0:15797:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836661.000286:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ade42b73800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788836661.000337:0:10309:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788836661.000447:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788836661.000541:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788836661.000672:0:7432:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8adf787eb000:7432] 2 exiting: rc = 0 00000100:00100000:3.0:1788836661.000732:0:6472:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8adf65b1f200:6472] 0 exiting: rc = 1 00000100:00100000:1.0:1788836661.010991:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8adf78680400:6473] 1 exiting: rc = 0 00000100:00100000:3.0:1788836661.011088:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.011499:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8adf45103600:6476] 2 exiting: rc = 0 00000100:00100000:1.0:1788836661.021767:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8adf65b1ee00:6475] 1 exiting: rc = 0 00000100:00100000:0.0:1788836661.091769:0:13174:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ade42531600:13174] 3 exiting: rc = 0 00000100:00100000:0.0:1788836661.091913:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8adf65b1f000:6474] 0 exiting: rc = 1 00000100:00100000:3.0:1788836661.092193:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092202:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092208:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092215:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092221:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092227:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092233:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092238:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092243:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092248:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092253:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092258:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092263:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092279:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092285:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092290:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092297:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092302:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092308:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092315:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092320:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092326:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092331:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092336:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092342:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092346:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092351:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092356:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092361:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092366:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092370:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092375:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092380:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092397:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092403:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092408:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092413:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092418:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092423:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092429:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092434:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092438:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092444:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092449:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092454:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092460:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092464:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092470:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092475:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092480:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092484:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092501:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092506:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092511:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092516:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092520:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092526:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092531:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092536:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092542:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092546:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092551:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092555:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.092567:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788836661.093322:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836661.093332:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788836661.093338:0:15797:0:(genops.c:885:class_export_put()) final put ffff8ade42b76000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788836661.093342:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade42b76000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788836661.093354:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788836661.093404:0:15797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf7fbb1000 1 00000020:00000080:3.0:1788836661.093410:0:15797:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7b38383a6553e3d 00000020:00000080:3.0:1788836661.093416:0:15797:0:(genops.c:885:class_export_put()) final put ffff8ade4252b000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788836661.093426:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788836661.093437:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ade4252b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788836661.093447:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836661.093452:0:15797:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788836661.093456:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8adf7fb819b8) has no exports 00000020:00000080:2.0:1788836661.165406:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836661.165421:0:15797:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788836661.165451:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf7fbb0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788836661.165456:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf7fbb0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788836661.165470:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788836661.165894:0:15797:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adf7fbb6000 00000020:01000000:2.0:1788836661.165915:0:15797:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788836661.165920:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836661.165924:0:15797:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788836661.165929:0:15797:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8adf7713b370) has no exports 00000020:00000080:2.0:1788836661.165957:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836661.165963:0:15797:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788836661.165967:0:15797:0:(genops.c:885:class_export_put()) final put ffff8adf77f57800/OSS_uuid 00000020:00000080:2.0:1788836661.165969:0:15797:0:(genops.c:844:class_export_destroy()) destroying export ffff8adf77f57800/OSS_uuid for OSS 00000020:01000000:2.0:1788836661.165973:0:15797:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788836661.166095:0:8498:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ade42549400:8498] 3 exiting: rc = 0 00000100:00100000:2.0:1788836661.166196:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8adf817a3600:8408] 2 exiting: rc = 0 00000100:00100000:2.0:1788836661.166253:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8adf817a2a00:8405] 0 exiting: rc = 1 00000100:00100000:2.0:1788836661.166308:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8adf7a4e3600:8407] 1 exiting: rc = 0 00000100:00100000:2.0:1788836661.166363:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166371:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166377:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166389:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166396:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166401:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166406:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166411:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166416:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166422:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166428:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166433:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166438:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166443:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166448:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166453:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166458:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166469:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166476:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.166481:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788836661.167409:0:6486:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788836661.169337:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169343:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169352:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169359:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169367:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169372:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169377:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169383:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169388:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169394:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169399:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169404:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169409:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169414:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169419:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169424:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169429:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169435:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169440:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169446:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169452:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169458:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169464:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169469:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169475:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169481:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169936:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169947:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169953:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169958:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169967:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.169972:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170061:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170073:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170082:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170099:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170104:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170110:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170115:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170121:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170126:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170131:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170136:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.170141:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.177224:0:10185:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8adf78526e00:10185] 2 exiting: rc = 0 00000100:00100000:0.0:1788836661.177595:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8adf80a94e00:8410] 1 exiting: rc = 0 00000100:00100000:0.0:1788836661.184007:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8adf772e1400:8409] 0 exiting: rc = 1 00000100:00100000:2.0:1788836661.188940:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188952:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188959:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188965:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188971:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188976:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188983:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188988:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188994:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.188999:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189004:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189028:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189035:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189041:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189048:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189056:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189063:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189069:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189075:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189084:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189093:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189102:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189107:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189112:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189117:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189138:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189142:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189147:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189152:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189156:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189161:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189166:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189196:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189202:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189207:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189213:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189218:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189223:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189228:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189232:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189237:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189241:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189246:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189251:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189256:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189260:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189276:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189282:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189287:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189291:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189297:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189303:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189308:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189314:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189319:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189325:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189330:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189335:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189340:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189345:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189358:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189363:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189368:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.189374:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.192583:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8adf7a4e3200:8413] 2 exiting: rc = 0 00000100:00100000:3.0:1788836661.196604:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8adf787e0a00:8411] 0 exiting: rc = 1 00000100:00100000:3.0:1788836661.196809:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8adf787e1a00:8412] 1 exiting: rc = 0 00000100:00100000:2.0:1788836661.197593:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197614:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197622:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197627:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197632:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197638:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197643:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197648:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197653:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197658:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197673:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197680:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197686:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197692:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197697:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197702:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197708:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197714:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197719:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197724:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197729:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197734:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197739:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197744:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197749:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197755:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197760:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197765:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197770:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197775:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197780:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197799:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197803:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197809:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197828:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197833:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197838:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197844:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197849:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197854:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197858:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197864:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197869:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197874:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197880:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197885:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197892:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197897:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197903:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197909:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197913:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197919:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197924:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197930:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197936:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197942:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197947:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197953:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197960:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197965:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197971:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197977:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197983:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836661.197996:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836661.212367:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8adf7a490200:8414] 0 exiting: rc = 1 00000100:00100000:3.0:1788836661.215712:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8adf77334600:8415] 1 exiting: rc = 0 00000100:00100000:1.0:1788836661.215803:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215814:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215823:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215829:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215834:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215840:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215859:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215864:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215870:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215875:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215880:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215885:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215889:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215894:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215898:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215903:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215908:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215913:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215917:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215922:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215929:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215934:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215938:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215943:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215948:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215952:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215957:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215961:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215967:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215973:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215979:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215984:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215989:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215994:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.215998:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216003:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216008:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216031:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216036:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216041:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216045:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216058:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216064:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216068:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216073:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216079:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216084:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216089:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216094:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216099:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216105:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216109:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216115:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216120:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216125:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216129:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216134:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216139:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216143:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216148:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216154:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216159:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216164:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.216169:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836661.218283:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8adf77334200:8416] 0 exiting: rc = 1 00000100:00100000:0.0:1788836661.222338:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8adf77334800:8417] 1 exiting: rc = 0 00000100:00100000:1.0:1788836661.222433:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222478:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222489:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222496:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222503:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222509:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222515:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222522:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222528:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222535:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222541:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222546:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222567:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222592:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222601:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222610:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222621:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222628:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222634:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222640:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222646:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222654:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222660:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222666:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222672:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222692:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222699:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222705:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222711:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222718:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222723:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222729:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.222735:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223113:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223122:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223127:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223133:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223156:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223164:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223171:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223179:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223187:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223195:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223201:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223208:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223218:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223228:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223241:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223248:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223281:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223289:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223296:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223302:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223308:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223315:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223321:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223327:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223335:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223341:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223356:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223364:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223372:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223380:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836661.223394:0:15797:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788836661.235182:0:15797:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788836681.499746:0:16561:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788836692.572132:0:17160:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836692.572141:0:17160:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788836692.572142:0:17160:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788836692.572217:0:17160:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ade44565800 00000020:01000004:2.0:1788836692.572230:0:17160:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788836692.572235:0:17160:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836692.572247:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ade42543370) 00000020:00000080:2.0:1788836692.572257:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788836692.644717:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788836692.645932:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.647727:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.648447:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.648700:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.648932:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.649284:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.649519:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.649702:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.649931:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.650235:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.650447:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.650648:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.650868:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788836692.651904:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788836692.657793:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.658310:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788836692.658520:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.658727:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.658919:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788836692.661865:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788836692.662572:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.662924:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788836692.663257:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788836692.663515:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.663714:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.664219:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.664482:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788836692.664682:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.668405:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.670803:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.671325:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.671546:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.671859:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.672116:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.672424:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.672751:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.672955:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.673230:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.673778:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.674383:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.675183:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.675515:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.675873:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.676241:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.676478:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788836692.676841:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788836692.679246:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788836692.680234:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788836692.680779:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788836692.682079:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788836692.682526:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788836692.682840:0:17160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788836692.683740:0:17160:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788836692.683959:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788836692.683968:0:17160:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788836692.683980:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6555081 00000020:01000004:1.0:1788836692.683988:0:17160:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788836692.683993:0:17160:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788836692.683998:0:17160:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ade44565800 from MGS 00000020:01000004:1.0:1788836692.684001:0:17160:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788836692.684036:0:17160:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ade43704d28) 00000020:00000080:1.0:1788836692.684060:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788836692.684119:0:17160:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ade44565800 from MGS, refs=2 00080000:01000000:1.0:1788836692.684125:0:17160:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836692.684130:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a655508f 00000100:00100000:1.0:1788836692.684237:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788836692.684387:0:17160:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788836692.684394:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788836692.689796:0:17160:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788836692.689818:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788836692.697632:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836692.698568:0:17160:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788836692.698577:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788836692.702638:0:17160:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788836692.702655:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788836692.703166:0:17160:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788836692.703174:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788836692.704655:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836692.704668:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836692.704670:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836692.715408:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836692.715415:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836692.715418:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836692.717317:0:17160:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788836692.719230:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788836692.727929:0:17160:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788836692.740774:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788836692.740829:0:17160:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788836692.740884:0:17160:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788836692.742584:0:17160:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788836692.742917:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836692.743337:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788836692.743345:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788836692.744879:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788836692.744890:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788836692.745378:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788836692.745384:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788836692.746294:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788836692.746319:0:17160:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:2.0:1788836692.746321:0:17160:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788836692.746350:0:17160:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:2.0:1788836692.746365:0:17160:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (ffff8ade425419b8) 00000020:00000080:2.0:1788836692.746380:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788836692.746458:0:17160:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade44566000@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00000100:00080000:0.0:1788836692.746733:0:17177:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1788836692.747005:0:17160:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:2.0:1788836692.747209:0:17160:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788836692.748211:0:17178:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788836692.748308:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2) 00000020:00000080:3.0:1788836692.748327:0:17160:0:(genops.c:1385:class_connect()) connect: client ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2, cookie 0xf7b38383a655509d 00000100:00080000:3.0:1788836692.748339:0:17160:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836692.748344:0:17160:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff8ade44566000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836692.748377:0:17160:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77368e00 x1875730782924672/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836692.748399:0:17160:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2->MGS 00000020:01000004:3.0:1788836692.748415:0:17160:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788836692.748421:0:17160:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788836692.748432:0:17160:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8adf817b4d28) 00000020:00000080:3.0:1788836692.748449:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788836692.748594:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3613:1875730782924672:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788836692.748656:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.748702:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782924672 00000100:00100000:1.0:1788836692.748710:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782924672 00000100:00100000:1.0:1788836692.748800:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836692.748809:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875730782924672:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788836692.748831:0:17174:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1788836692.748850:0:17174:0:(genops.c:1385:class_connect()) connect: client ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2, cookie 0xf7b38383a65550ab 00000100:00080000:1.0:1788836692.748981:0:17174:0:(import.c:65:import_set_state_nolock()) ffff8adf78605800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836692.749072:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:3613:x1875730782924672:12345-0@lo:250:mount.lustre.0 Request processed in 263us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836692.749080:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836692.750145:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788836692.750157:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1788836692.750165:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788836692.750170:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788836692.750173:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade44566000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788836692.750176:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788836692.750233:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788836692.750240:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3613:1875730782924672:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788836692.771939:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836692.772424:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788836692.772431:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788836692.773549:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788836692.773560:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788836692.778350:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836692.778363:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788836692.790384:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836692.790610:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788836692.790617:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788836692.793974:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788836692.793990:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788836692.852834:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836692.853076:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788836692.853081:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788836692.856860:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788836692.856872:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788836692.857413:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836692.857595:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836692.857599:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788836692.857986:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788836692.857992:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788836692.858548:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836692.858726:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788836692.858731:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788836692.861124:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788836692.861199:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788836692.861776:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836692.861953:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788836692.861957:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788836692.863075:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788836692.863084:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788836692.903849:0:17160:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836692.906390:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836692.906404:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788836692.907673:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836692.907685:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788836692.908448:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836692.908458:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788836692.914991:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788836692.915120:0:17160:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788836692.915126:0:17160:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788836692.915246:0:17160:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788836692.916796:0:17160:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788836692.916806:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788836692.916808:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836692.916809:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836692.916810:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836692.916811:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836692.916812:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836692.916814:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836692.916815:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836692.916817:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836692.916818:0:17160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836692.916822:0:17160:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788836692.916835:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836692.916836:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836692.916838:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836692.916839:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836692.916840:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836692.916840:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836692.916841:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836692.916843:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836692.916844:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836692.916845:0:17160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836692.916874:0:17160:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788836692.916897:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782924800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836692.916980:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836692.917273:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782924800 00000100:00100000:0.0:1788836692.917281:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782924800 00000100:00100000:1.0:1788836692.917325:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf432c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836692.920873:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836692.920896:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:17160:x1875730782924800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836692.920963:0:17176:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836692.920971:0:17176:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788836692.920974:0:17176:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788836692.925111:0:17197:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788836692.925733:0:17176:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788836692.927301:0:17198:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788836692.927308:0:17198:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788836692.927311:0:17198:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788836692.927314:0:17198:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788836692.927588:0:17198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788836692.928074:0:17176:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836692.928086:0:17176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788836692.930806:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:17160:x1875730782924800:12345-0@lo:253:mount.lustre.0 Request processed in 9907us (13811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836692.930823:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836692.930931:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782924800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788836692.930944:0:17160:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788836692.930947:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836692.930948:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836692.930949:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836692.930950:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836692.930951:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836692.930952:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836692.930953:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836692.930954:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836692.930955:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836692.930956:0:17160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788836692.930971:0:17160:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ade44565800 from lustre-MDT0000 10000000:01000000:1.0:1788836692.930997:0:17160:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788836692.930999:0:17160:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788836692.931003:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ade425419b8 10000000:01000000:1.0:1788836692.931006:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836692.931028:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ade425419b8 from 1 10000000:01000000:1.0:1788836692.931030:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788836692.931058:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.931077:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.931085:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836692.931099:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782924928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836692.931126:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.931161:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836692.931223:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782924928 00000100:00100000:0.0:1788836692.931230:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782924928 00000100:00100000:0.0:1788836692.931491:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836692.931502:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:17160:x1875730782924928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836692.931514:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836692.931535:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993400/0xf7b38383a65550b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65550b2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836692.931560:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993400/0xf7b38383a65550b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65550b2 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836692.931570:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993400/0xf7b38383a65550b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65550b2 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836692.931579:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993400, rc 0) 00000100:00100000:0.0:1788836692.931623:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:17160:x1875730782924928:12345-0@lo:101:mount.lustre.0 Request processed in 122us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836692.931630:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836692.931692:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782924928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836692.931704:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.931725:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836692.931778:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836692.931803:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836692.939510:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925056 00000100:00100000:3.0:1788836692.939525:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925056 00000100:00100000:1.0:1788836692.939553:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836692.939579:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836692.939588:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:17160:x1875730782925056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836692.939725:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:17160:x1875730782925056:12345-0@lo:501:mount.lustre.0 Request processed in 128us (7910us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836692.939733:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836692.940058:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788836692.940102:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788836692.940121:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940133:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836692.940170:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ade44565800 10000000:01000000:1.0:1788836692.940175:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836692.940180:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ade44565800 10000000:01000000:1.0:1788836692.940182:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788836692.940185:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ade44565800 from 1 10000000:01000000:1.0:1788836692.940188:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788836692.940218:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940226:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940235:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836692.940254:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836692.940305:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.940331:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925184 00000100:00100000:1.0:1788836692.940336:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925184 00000100:00100000:1.0:1788836692.940356:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836692.940362:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:17160:x1875730782925184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836692.940371:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836692.940383:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae6200/0xf7b38383a65550c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65550c0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940403:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae6200/0xf7b38383a65550c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65550c0 expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940423:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae6200/0xf7b38383a65550c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65550c0 expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940432:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6200, rc 0) 00000100:00100000:1.0:1788836692.940457:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+7:17160:x1875730782925184:12345-0@lo:101:mount.lustre.0 Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836692.940463:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836692.940488:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836692.940500:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836692.940511:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550c7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940520:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65550c7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836692.940537:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788836692.940542:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550c7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940549:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6400/0xf7b38383a65550c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550c7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836692.940555:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788836692.940558:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836692.940562:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ade44565800 10000000:01000000:1.0:1788836692.940565:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788836692.940568:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788836692.940574:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788836692.940589:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940596:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.940604:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836692.940615:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836692.940640:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836692.940652:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925312 00000100:00100000:3.0:1788836692.940656:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925312 00000100:00100000:1.0:1788836692.940658:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836692.940752:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836692.940760:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+7:17160:x1875730782925312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836692.940767:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836692.940776:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701600/0xf7b38383a65550d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65550ce expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836692.940790:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701600/0xf7b38383a65550d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65550ce expref: 8 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836692.940797:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701600/0xf7b38383a65550d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65550ce expref: 8 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836692.940814:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701600, rc 0) 00000100:00100000:3.0:1788836692.942163:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+8:17160:x1875730782925312:12345-0@lo:101:mount.lustre.0 Request processed in 1396us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836692.942174:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836692.942922:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836692.942946:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550d5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836692.942959:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65550d5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836692.943055:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836692.943101:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.943134:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836692.943552:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925440 00000100:00100000:3.0:1788836692.943557:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925440 00000100:00100000:3.0:1788836692.943593:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836692.943601:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+8:17160:x1875730782925440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836692.943828:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17160:x1875730782925440:12345-0@lo:501:mount.lustre.0 Request processed in 227us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836692.943835:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836692.943905:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836692.943938:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836692.943986:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.944047:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4683c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836692.944126:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925568 00000100:00100000:2.0:1788836692.944131:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925568 00000100:00100000:2.0:1788836692.944238:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836692.944246:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17160:x1875730782925568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836692.944970:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17160:x1875730782925568:12345-0@lo:503:mount.lustre.0 Request processed in 724us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836692.944978:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836692.945159:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782925568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836692.949384:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17199:1875730782925696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836692.949486:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.949536:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836692.950066:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925696 00000100:00100000:2.0:1788836692.950075:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925696 00000100:00100000:2.0:1788836692.950131:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836692.950152:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17199:x1875730782925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836692.954810:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17199:x1875730782925696:12345-0@lo:502:llog_process_th.0 Request processed in 4650us (5315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836692.954825:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836692.954951:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17199:1875730782925696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836692.954989:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836692.955002:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836692.955005:0:17199:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788836692.955026:0:17199:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788836692.955030:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836692.955045:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ade43700000) 00000020:00000080:1.0:1788836692.955063:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788836692.955070:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788836692.955149:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788836692.955157:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a65550e3 00000020:00000080:1.0:1788836692.955375:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788836692.955379:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836692.955382:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836692.955384:0:17199:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788836692.955387:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836692.955390:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836692.955392:0:17199:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788836692.955395:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836692.955403:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ade43703370) 00000020:00000080:1.0:1788836692.955413:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788836692.955416:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788836692.955418:0:17199:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788836692.955421:0:17199:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788836692.955427:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836692.955602:0:17199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ade44565800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788836692.955617:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ade437019b8) 00000020:00000080:1.0:1788836692.955634:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788836692.955884:0:17199:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788836692.955891:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a65550f8 00000020:00000080:1.0:1788836692.955990:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788836692.955997:0:17199:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788836692.956001:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7b38383a65550ff 00080000:01000000:1.0:1788836692.956006:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788836692.956039:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6555106 00010000:00010000:2.0:1788836693.019051:0:17199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788836693.019833:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788836693.020277:0:17199:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788836693.021038:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8adf7fb80000) 00000020:00000080:0.0:1788836693.021059:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788836693.021159:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788836693.021167:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6555114 00000020:00000080:1.0:1788836693.021699:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788836693.026832:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7b38383a655511b 00000020:00000080:2.0:1788836693.029226:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788836693.029241:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836693.029249:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.029251:0:17199:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788836693.029256:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836693.029258:0:17199:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788836693.029260:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836693.029262:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836693.029263:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836693.029266:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.029267:0:17199:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836693.029270:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836693.029275:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.029276:0:17199:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788836693.029281:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788836693.029394:0:17199:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788836693.029412:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836693.029415:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.029417:0:17199:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788836693.029419:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836693.029423:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.029424:0:17199:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788836693.029428:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836693.029433:0:17199:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:00000080:2.0:1788836693.029459:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836693.029475:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ade42544d28) 00000020:00000080:2.0:1788836693.029493:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788836693.029498:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836693.029555:0:17199:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788836693.029561:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788836693.029569:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6555129 00010000:00080000:2.0:1788836693.029601:0:17199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf7a6bb800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788836693.036894:0:17199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788836693.042676:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836693.042693:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788836693.042747:0:17199:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836693.042769:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6555130 00000100:00080000:0.0:1788836693.042781:0:17199:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836693.042787:0:17199:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836693.042825:0:17199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44709500 x1875730782925824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836693.042868:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782925824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836693.042935:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836693.043027:0:17199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788836693.043105:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836693.043110:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.043112:0:17199:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788836693.043115:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836693.043117:0:17199:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788836693.043119:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836693.043121:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836693.043122:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836693.043124:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.043126:0:17199:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836693.043129:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836693.043133:0:17199:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788836693.043146:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.043148:0:17199:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788836693.043154:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836693.043158:0:17199:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:0.0:1788836693.043178:0:17199:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788836693.043181:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836693.043206:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8adf7fb819b8) 00000020:00000080:0.0:1788836693.043218:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788836693.043223:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836693.043295:0:17199:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788836693.043301:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788836693.043307:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a655513e 00010000:00080000:0.0:1788836693.043334:0:17199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf7a4a7800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836693.043544:0:17199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788836693.045463:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782925824 00000100:00100000:3.0:1788836693.045477:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782925824 00000100:00100000:3.0:1788836693.045518:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836693.045527:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782925824:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788836693.045547:0:17186:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788836693.047338:0:17199:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836693.047581:0:17199:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788836693.049920:0:17199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836693.052283:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788836693.065563:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788836693.069000:0:17205:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788836693.069037:0:17205:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788836693.073264:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836693.073281:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836693.073329:0:17199:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788836693.073351:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6555145 00000100:00080000:2.0:1788836693.073364:0:17199:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836693.073370:0:17199:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adf7a4a7800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836693.073423:0:17199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e2a00 x1875730782925952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836693.073455:0:17199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788836693.073559:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836693.073564:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.073566:0:17199:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788836693.073568:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836693.073572:0:17199:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788836693.073573:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836693.073575:0:17199:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836693.073576:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836693.073578:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.073579:0:17199:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836693.073582:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836693.073585:0:17199:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788836693.073589:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836693.073590:0:17199:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788836693.073593:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836693.073596:0:17199:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:2.0:1788836693.073623:0:17199:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836693.073626:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836693.073640:0:17199:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ade42540000) 00000020:00000080:2.0:1788836693.073652:0:17199:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788836693.073656:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836693.073727:0:17199:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788836693.073733:0:17199:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788836693.073739:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7b38383a6555153 00010000:00080000:2.0:1788836693.073783:0:17199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf50b5f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788836693.073989:0:17199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788836693.074092:0:17199:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836693.074107:0:17199:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788836693.074301:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782925952:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836693.074357:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782925952 offset 0 length 520: 4 00000100:00100000:2.0:1788836693.087596:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782925824:12345-0@lo:38:llog_process_th.0 Request processed in 42064us (44657us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836693.087617:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788836693.089239:0:17199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836693.089482:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788836693.089609:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1788836693.091340:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836693.091351:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836693.091356:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782925824:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788836693.093095:0:17207:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788836693.093102:0:17207:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788836693.093950:0:17199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836693.093963:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836693.094002:0:17199:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836693.094063:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a655515a 00000100:00080000:0.0:1788836693.094074:0:17199:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836693.094081:0:17199:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836693.094119:0:17199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44709c00 x1875730782926080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836693.094466:0:17199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788836693.094533:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836693.094537:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.094539:0:17199:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788836693.094543:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836693.094547:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.094548:0:17199:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836693.094551:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836693.094553:0:17199:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788836693.094556:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836693.094558:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.094559:0:17199:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788836693.094570:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836693.094573:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.094574:0:17199:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788836693.094578:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788836693.094612:0:17199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17199:1875730782926208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.094688:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836693.094740:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926208 00000100:00100000:0.0:1788836693.094747:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926208 00000100:00100000:0.0:1788836693.094785:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836693.094795:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17199:x1875730782926208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.094905:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17199:x1875730782926208:12345-0@lo:502:llog_process_th.0 Request processed in 111us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.094913:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836693.094963:0:17199:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.094983:0:17199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17199:1875730782926208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836693.095006:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836693.095033:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836693.095035:0:17199:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788836693.095199:0:17199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:1.0:1788836693.095365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836693.095370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788836693.095373:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836693.095377:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788836693.095382:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836693.095385:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836693.095401:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428d9500 x1875730782926464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836693.095412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836693.095415:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836693.095417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836693.095420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836693.095488:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782926336:0@lo:400:kworker.0 00000100:00100000:0.0:1788836693.095516:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836693.095742:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782926080:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788836693.095776:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782926080 offset 0 length 520: 4 00000100:00100000:2.0:1788836693.095791:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782926464:0@lo:38:kworker.0 00000100:00100000:2.0:1788836693.095814:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836693.095889:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926336 00000100:00100000:1.0:1788836693.095895:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926336 00000100:00100000:1.0:1788836693.095923:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836693.095939:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:3617:x1875730782926336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836693.095980:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:3617:x1875730782926336:12345-0@lo:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.095987:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836693.096446:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782926336:0@lo:400:kworker.0 00000100:00100000:0.0:1788836693.096479:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926464 00000100:00100000:0.0:1788836693.096483:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926464 00000100:00100000:0.0:1788836693.096511:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836693.096515:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782926464:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788836693.096531:0:17187:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836693.096573:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782926464:12345-0@lo:38:kworker.0 Request processed in 55us (757us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836693.096579:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788836693.096641:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836693.096645:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836693.096648:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782926464:0@lo:38:kworker.0 00000020:01000000:3.0:1788836693.096827:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788836693.096856:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836693.096911:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550d5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.096923:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7000/0xf7b38383a65550ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550d5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836693.096931:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade44565800 from 1 10000000:01000000:3.0:1788836693.096934:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836693.096971:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.096979:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.096989:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.097006:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836693.097261:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.097322:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.101256:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926592 00000100:00100000:0.0:1788836693.101273:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926592 00000100:00100000:0.0:1788836693.101339:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836693.101351:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+9:17160:x1875730782926592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836693.101368:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836693.101387:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555161 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.101419:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555161 expref: 10 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.101430:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555161 expref: 10 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.101441:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993e00, rc 0) 00000100:00100000:0.0:1788836693.101531:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+10:17160:x1875730782926592:12345-0@lo:101:mount.lustre.0 Request processed in 183us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.101539:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836693.101685:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836693.101705:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.101724:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.102419:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926720:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788836693.102472:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.102509:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.102597:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926720 00000100:00100000:0.0:1788836693.102603:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926720 00000100:00100000:0.0:1788836693.102689:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836693.102698:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+10:17160:x1875730782926720:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788836693.102725:0:17174:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788836693.102733:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788836693.102809:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+10:17160:x1875730782926720:12345-0@lo:256:mount.lustre.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.102824:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836693.102890:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926720:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788836693.103632:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836693.103661:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.103673:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836693.103743:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade44565800 from 1 10000000:01000000:3.0:1788836693.103746:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836693.103776:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.103784:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.103793:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.103809:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836693.103845:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.107530:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.107695:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926848 00000100:00100000:1.0:1788836693.107705:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926848 00000100:00100000:1.0:1788836693.107763:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836693.107773:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+10:17160:x1875730782926848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836693.107788:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836693.107806:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655516f expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.107833:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655516f expref: 11 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.107844:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655516f expref: 11 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.107853:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6e00, rc 0) 00000100:00100000:1.0:1788836693.108033:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782926848:12345-0@lo:101:mount.lustre.0 Request processed in 260us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.108052:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836693.108397:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836693.108415:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.108425:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.108497:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836693.108533:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.108604:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.108643:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782926976 00000100:00100000:1.0:1788836693.108648:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782926976 00000100:00100000:1.0:1788836693.108706:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836693.108723:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782926976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836693.108861:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782926976:12345-0@lo:501:mount.lustre.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.108884:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836693.108947:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782926976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836693.108974:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836693.109056:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.109453:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.109490:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927104 00000100:00100000:0.0:1788836693.109496:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927104 00000100:00100000:2.0:1788836693.109579:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836693.109589:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782927104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836693.109690:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782927104:12345-0@lo:503:mount.lustre.0 Request processed in 102us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836693.109697:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836693.109788:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836693.110324:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17209:1875730782927232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836693.110363:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.110388:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836693.110437:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927232 00000100:00100000:2.0:1788836693.110442:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927232 00000100:00100000:2.0:1788836693.110478:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836693.110486:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17209:x1875730782927232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836693.110931:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17209:x1875730782927232:12345-0@lo:502:llog_process_th.0 Request processed in 444us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836693.110939:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836693.111288:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17209:1875730782927232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836693.111317:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836693.111326:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111328:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836693.111336:0:17209:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ade44565800 00000020:00000080:3.0:1788836693.111338:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836693.111346:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836693.111348:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111349:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788836693.111352:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836693.111354:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111355:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788836693.111358:0:17209:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ade44565800 00000020:00000080:3.0:1788836693.111360:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836693.111414:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836693.111418:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111419:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788836693.111422:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836693.111424:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111425:0:17209:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836693.111429:0:17209:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ade44565800 00000020:00000080:3.0:1788836693.111431:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836693.111448:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836693.111451:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111458:0:17209:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836693.111461:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836693.111464:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.111465:0:17209:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788836693.111468:0:17209:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ade44565800 00000020:00000080:3.0:1788836693.111470:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788836693.111505:0:17209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17209:1875730782927360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836693.111541:0:17209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.111573:0:17209:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.112554:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927360 00000100:00100000:1.0:1788836693.112561:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927360 00000100:00100000:1.0:1788836693.112602:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836693.112611:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17209:x1875730782927360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836693.112745:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17209:x1875730782927360:12345-0@lo:502:llog_process_th.0 Request processed in 135us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.112752:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836693.113263:0:17209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17209:1875730782927360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836693.113292:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836693.113298:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836693.113300:0:17209:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788836693.113304:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788836693.113461:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788836693.113480:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836693.113494:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113505:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836693.113552:0:17160:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788836693.113555:0:17160:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ade44565800 10000000:01000000:1.0:1788836693.113558:0:17160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ade44565800 10000000:01000000:1.0:1788836693.113563:0:17160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836693.113569:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ade44565800 from 1 10000000:01000000:1.0:1788836693.113571:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836693.113599:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113607:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113615:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836693.113639:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836693.113675:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836693.113703:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b1e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.113727:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927488 00000100:00100000:1.0:1788836693.113732:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927488 00000100:00100000:1.0:1788836693.113756:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836693.113763:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17160:x1875730782927488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836693.113772:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836693.113784:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae6000/0xf7b38383a6555184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655517d expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113806:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae6000/0xf7b38383a6555184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655517d expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113815:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae6000/0xf7b38383a6555184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655517d expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113822:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6000, rc 0) 00000100:00100000:1.0:1788836693.113852:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782927488:12345-0@lo:101:mount.lustre.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.113859:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836693.113891:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836693.113903:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555184 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836693.113911:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555184 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836693.113965:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836693.113988:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836693.114001:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b1e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.114034:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927616 00000100:00100000:1.0:1788836693.114038:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927616 00000100:00100000:1.0:1788836693.114055:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788836693.114060:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782927616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836693.117309:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782927616:12345-0@lo:501:mount.lustre.0 Request processed in 3241us (3312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.117325:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836693.117453:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836693.117520:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836693.117564:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836693.117602:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836693.118205:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927744 00000100:00100000:1.0:1788836693.118213:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927744 00000100:00100000:1.0:1788836693.118259:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836693.118269:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782927744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836693.118378:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782927744:12345-0@lo:503:mount.lustre.0 Request processed in 111us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836693.118385:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836693.118469:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782927744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836693.125375:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782927872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.125455:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836693.125494:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782927872 00000100:00100000:0.0:1788836693.125501:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782927872 00000100:00100000:0.0:1788836693.125545:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836693.125554:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782927872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.125673:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782927872:12345-0@lo:502:llog_process_th.0 Request processed in 118us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.125681:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836693.125740:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.125761:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782927872:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788836693.125821:0:17211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788836693.125837:0:17211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8adf7fb84d28) 00000020:00000080:0.0:1788836693.125856:0:17211:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788836693.125939:0:17211:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ade44565800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836693.125943:0:17211:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ade44565800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836693.125950:0:17211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ade44565800 4 00010000:00080000:0.0:1788836693.125979:0:17211:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf4395c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836693.130100:0:17211:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788836693.132441:0:17211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788836693.132487:0:17211:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836693.132503:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7b38383a6555192 00000100:00080000:0.0:1788836693.132513:0:17211:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836693.132519:0:17211:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adf4395c800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836693.132555:0:17211:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44708a80 x1875730782928000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836693.138249:0:17211:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788836693.138284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836693.138290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836693.138293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836693.138296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836693.149417:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782928128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836693.149505:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836693.149554:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf517b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836693.149837:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782928000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836693.149876:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836693.153268:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928128 00000100:00100000:0.0:1788836693.153282:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928128 00000100:00100000:0.0:1788836693.153345:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836693.153356:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782928128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.153525:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782928128:12345-0@lo:502:llog_process_th.0 Request processed in 170us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.153534:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836693.153597:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782928128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.153658:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782928256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.153698:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836693.153740:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928256 00000100:00100000:0.0:1788836693.153744:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928256 00000100:00100000:0.0:1788836693.153767:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836693.153774:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782928256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836693.153830:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17211:x1875730782928256:12345-0@lo:502:llog_process_th.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.153837:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836693.153875:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c45540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.153887:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17211:1875730782928256:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788836693.153905:0:17211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788836693.156129:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788836693.156223:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836693.156239:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555184 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836693.156251:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6a00/0xf7b38383a655517d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555184 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836693.156302:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836693.156305:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836693.156307:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836693.156308:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836693.156309:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836693.156311:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836693.156312:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836693.156313:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836693.156315:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836693.156316:0:17160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836693.156320:0:17160:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788836693.156323:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836693.156324:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836693.156325:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836693.156326:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836693.156328:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836693.156328:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836693.156329:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836693.156330:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836693.156331:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836693.156338:0:17160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836693.156361:0:17160:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788836693.156380:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782928384:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836693.156439:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836693.156472:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836693.158646:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928384 00000100:00100000:3.0:1788836693.158661:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928384 00000100:00100000:3.0:1788836693.158799:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836693.158811:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782928384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836693.158845:0:17176:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788836693.158860:0:17176:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788836693.166609:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928000 00000100:00100000:2.0:1788836693.166626:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928000 00000100:00100000:2.0:1788836693.166690:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836693.166699:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782928000:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836693.166813:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782928000:12345-0@lo:38:llog_process_th.0 Request processed in 113us (16935us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788836693.166820:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836693.166861:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836693.166870:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf4395c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836693.166875:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788836693.166879:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782928000:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788836693.170188:0:17176:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788836693.170211:0:17176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788836693.170511:0:17197:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788836693.170516:0:17197:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788836693.170540:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836693.170560:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836693.170568:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836693.170609:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836693.170640:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836693.170653:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782928512:0@lo:104: 00000100:00100000:2.0:1788836693.170725:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836693.170770:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7738e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836693.170837:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928512 00000100:00100000:0.0:1788836693.170845:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928512 00000100:00100000:0.0:1788836693.170896:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836693.170906:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782928512:12345-0@lo:104: 00010000:00010000:0.0:1788836693.170919:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.170978:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836693.170984:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782928512:12345-0@lo:104: Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.170991:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836693.171056:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782928512:0@lo:104: 00010000:00010000:0.0:1788836693.171074:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836693.171320:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17160:x1875730782928384:12345-0@lo:253:mount.lustre.0 Request processed in 12510us (14879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.171342:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836693.171754:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17160:1875730782928384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836693.171766:0:17160:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788836693.171769:0:17160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836693.171771:0:17160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836693.171773:0:17160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836693.171774:0:17160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836693.171775:0:17160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836693.171777:0:17160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836693.171784:0:17160:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836693.171785:0:17160:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836693.171787:0:17160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836693.171788:0:17160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788836693.171799:0:17160:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788836693.172276:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836693.172284:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.172293:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836693.172297:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.172307:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836693.172314:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836693.172319:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836693.172362:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.172369:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836693.172391:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.172398:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700a00/0xf7b38383a6555161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555168 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836693.172415:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836693.172418:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836693.172419:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836693.172648:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782928640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836693.172694:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.184535:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928640 00000100:00100000:3.0:1788836693.184549:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928640 00010000:00010000:3.0:1788836693.184586:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.184617:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836693.184627:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:3614:x1875730782928640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836693.184641:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836693.184647:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184660:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184678:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993e00/0xf7b38383a6555168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6555161 expref: 12 pid: 17176 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184694:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184702:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836693.184728:0:17166:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014212242s 00010000:00010000:3.0:1788836693.184734:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184741:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184761:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184767:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184773:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615ce00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836693.184777:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184786:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184802:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.184813:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836693.184887:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:3614:x1875730782928640:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (12192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836693.184895:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788836693.185110:0:17197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.185118:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836693.185125:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf6615ce00/0xf7b38383a6555199 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836693.185934:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782928640:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788836693.201362:0:17160:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788836693.209042:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788836693.209336:0:17221:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788836693.209342:0:17221:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788836693.209434:0:17222:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836693.209686:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788836693.212403:0:17222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788836693.213592:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788836693.213641:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788836693.214074:0:17160:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788836693.214082:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788836693.214119:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836693.218953:0:17160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:3.0:1788836693.220203:0:17223:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8adf77369c00 x1875730782928768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836693.220219:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000040:00080000:2.0:1788836693.220701:0:17222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788836693.220780:0:17222:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788836693.222778:0:17160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788836693.222852:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788836693.225892:0:17160:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788836693.231568:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788836693.233791:0:17160:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788836693.233827:0:17160:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2ab019b7988 00100000:10000000:1.0:1788836693.233835:0:17160:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788836693.235995:0:17160:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836693.236038:0:17160:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836693.236060:0:17160:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788836693.236078:0:17160:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788836693.245812:0:17160:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836693.246053:0:17160:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788836693.758314:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836694.210631:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836694.270150:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 10000000:01000000:3.0:1788836694.526531:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836694.526539:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade44565800 from 7 10000000:01000000:3.0:1788836694.526545:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836694.526597:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836694.526608:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836694.526619:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836694.526644:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782928896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836694.526724:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836694.526801:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf72c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836694.526912:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928896 00000100:00100000:0.0:1788836694.526920:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928896 00000100:00100000:0.0:1788836694.526974:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836694.526983:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+11:17178:x1875730782928896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836694.526996:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836694.527302:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65551a0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836694.529993:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836694.530027:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836694.530038:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993600, rc 0) 00000100:00100000:1.0:1788836694.530141:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17178:x1875730782928896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3157us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836694.530150:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836694.530652:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782928896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836694.530673:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836694.530683:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836694.530765:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782929024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836694.530814:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836694.530849:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf72c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836694.530921:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929024 00000100:00100000:0.0:1788836694.530928:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929024 00000100:00100000:0.0:1788836694.530973:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836694.530982:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17178:x1875730782929024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836694.531002:0:17176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836694.531049:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836694.531053:0:17176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788836694.531162:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17178:x1875730782929024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836694.531170:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836694.531355:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782929024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836694.531412:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836694.531419:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836694.531428:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836694.789147:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836695.230855:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836695.303749:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836695.809147:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836696.319980:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:1.0:1788836696.832086:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836697.356759:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836697.857296:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836698.074857:0:17466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788836698.369879:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000100:00080000:1.0:1788836698.373788:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836698.373794:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788836698.373798:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836698.373806:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1788836698.373824:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788836698.373830:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836698.373854:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428db100 x1875730782929280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836698.373870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836698.373874:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836698.373876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836698.373879:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836698.373881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836698.373884:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788836698.373886:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf4395c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836698.373890:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adf4395c800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836698.373902:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428da680 x1875730782929408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836698.373977:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782929152:0@lo:400:kworker.0 00000100:00100000:1.0:1788836698.374071:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836698.374132:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929280:0@lo:38:kworker.0 00000100:00100000:1.0:1788836698.374167:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836698.374266:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782929408:0@lo:38:kworker.0 00000100:00100000:1.0:1788836698.374294:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836698.374336:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929152 00000100:00100000:1.0:1788836698.374344:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929152 00000100:00100000:1.0:1788836698.374390:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836698.374399:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:3615:x1875730782929152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836698.374454:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:3615:x1875730782929152:12345-0@lo:400:kworker.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836698.374462:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836698.374494:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929280 00000100:00100000:1.0:1788836698.374498:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929280 00000100:00100000:1.0:1788836698.374517:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836698.374522:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782929280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788836698.374540:0:17187:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836698.380476:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929408 00000100:00100000:3.0:1788836698.380492:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929408 00000100:00100000:3.0:1788836698.386441:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836698.386454:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875730782929408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788836698.386491:0:17183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1788836698.386533:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7b38383a65551ae 00000004:00100000:3.0:1788836698.386551:0:17183:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788836698.386722:0:17183:0:(import.c:65:import_set_state_nolock()) ffff8adf48aa4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836698.386824:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875730782929408:12345-0@lo:38:kworker.0 Request processed in 370us (12528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836698.386832:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788836698.400722:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ade428da680 x1875730782929408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836698.400744:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788836698.400754:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788836698.400759:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836698.400763:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf4395c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836698.400771:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875730782929408:0@lo:38:kworker.0 00000100:00100000:3.0:1788836698.401880:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782929152:0@lo:400:kworker.0 00000100:00100000:1.0:1788836698.402074:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782929280:12345-0@lo:38:kworker.0 Request processed in 27548us (27904us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788836698.402086:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788836698.402146:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836698.402152:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836698.402157:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929280:0@lo:38:kworker.0 00010000:00010000:1.0:1788836698.884787:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836699.090355:0:17518:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836699.090543:0:17518:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788836699.392384:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836699.903582:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788836699.939399:0:17568:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836699.939755:0:17568:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788836700.414659:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:1.0:1788836700.926130:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836701.443302:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836701.950886:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836702.466269:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836702.977066:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836703.486165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836703.486172:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788836703.486175:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836703.486182:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1788836703.486188:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788836703.486217:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836703.486242:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428db100 x1875730782929664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836703.486258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836703.486261:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836703.486264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836703.486267:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836703.486297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782929792:0@lo:400:kworker.0 00000100:00100000:1.0:1788836703.486358:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836703.486410:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836703.486417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782929536:0@lo:400:kworker.0 00000100:00100000:1.0:1788836703.486445:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836703.486480:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836693/real 1788836693] req@ffff8ade44709c00 x1875730782926080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836703.486497:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade44709c00 x1875730782926080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836703 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836703.486506:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836693/real 1788836693] req@ffff8ade445e2a00 x1875730782925952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836703.486517:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e2a00 x1875730782925952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836703 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836703.486529:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929664:0@lo:38:kworker.0 00000100:00100000:1.0:1788836703.486564:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836703.486589:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836703.486601:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836703.486605:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782926080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788836703.486610:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836703.486614:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836703.486617:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782925952:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788836703.486655:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000100:00100000:1.0:1788836703.486661:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929792 00000100:00100000:1.0:1788836703.486668:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929792 00000100:00100000:1.0:1788836703.486709:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836703.486718:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782929792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836703.486764:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782929792:12345-0@lo:400:kworker.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836703.486771:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836703.486794:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929536 00000100:00100000:1.0:1788836703.486797:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929536 00000100:00100000:1.0:1788836703.486818:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836703.486825:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:3617:x1875730782929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836703.486851:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:3617:x1875730782929536:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836703.486856:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836703.486895:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782929536:0@lo:400:kworker.0 00010000:00080000:1.0:1788836703.486905:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ade428d8700 x1875730782929792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836703.486915:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782929792:0@lo:400:kworker.0 00000100:00080000:1.0:1788836703.486930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836703.486938:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788836703.486940:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836703.486943:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788836703.486946:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836703.486949:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adf7a4a7800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836703.486963:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428d8700 x1875730782929920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836703.486976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836703.486979:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836703.486981:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836703.486984:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788836703.486986:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836703.486989:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836703.486999:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428da680 x1875730782930048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836703.487039:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929920:0@lo:8:kworker.0 00000400:00000100:1.0:1788836703.487063:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782929920 offset 0 length 520: 4 00000100:00100000:1.0:1788836703.487081:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782930048:0@lo:8:kworker.0 00000400:00000100:1.0:1788836703.487099:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782930048 offset 0 length 520: 4 00000100:00100000:3.0:1788836703.487622:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782929664 00000100:00100000:3.0:1788836703.487628:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782929664 00000100:00100000:3.0:1788836703.487660:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836703.487666:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782929664:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788836703.487690:0:17186:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836703.507268:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782929664:12345-0@lo:38:kworker.0 Request processed in 19593us (20693us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788836703.507288:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788836703.507291:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788836703.507293:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836703.507297:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929664:0@lo:38:kworker.0 00010000:00010000:3.0:1788836704.001860:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836704.514897:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:0.0:1788836705.025578:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836705.483747:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836705.534743:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:3.0:1788836706.046111:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836706.558213:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:1.0:1788836707.070706:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836707.220850:0:17913:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836707.220854:0:17913:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788836707.220855:0:17913:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788836707.221198:0:17913:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ade428c3000 00000020:01000004:2.0:1788836707.221213:0:17913:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788836707.221225:0:17913:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836707.221240:0:17913:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8adf442a19b8) 00000020:00000080:2.0:1788836707.221257:0:17913:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788836707.328986:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788836707.329636:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788836707.337125:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788836707.338744:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788836707.339212:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788836707.339447:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788836707.339710:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.345440:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.346426:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.346812:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.347242:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.347775:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.348393:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.348718:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.349149:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.349377:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.351618:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.352653:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.355240:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.355746:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.356155:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.358343:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.359608:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.360181:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.360803:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.361377:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.361653:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.361901:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.362463:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.362767:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.363252:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.363463:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788836707.363733:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.364173:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788836707.365132:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788836707.366330:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.366740:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.367136:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788836707.367615:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.367856:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.370721:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788836707.373258:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.373802:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788836707.374672:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788836707.375170:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788836707.375412:0:17913:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788836707.378833:0:17913:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836707.381229:0:17913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788836707.381244:0:17913:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836707.381258:0:17913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a65551bc 00000020:01000004:3.0:1788836707.381266:0:17913:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788836707.381288:0:17913:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836707.381292:0:17913:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836707.381298:0:17913:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788836707.381327:0:17913:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788836707.381331:0:17913:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836707.393378:0:17913:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836707.393438:0:17913:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788836707.393443:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836707.393445:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836707.393446:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836707.393447:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836707.393448:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836707.393449:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836707.393451:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836707.393452:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836707.393454:0:17913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836707.393458:0:17913:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788836707.393460:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836707.393462:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836707.393463:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836707.393992:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836707.393994:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836707.393995:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836707.393996:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836707.393998:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836707.393999:0:17913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836707.394105:0:17913:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788836707.394130:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836707.394232:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.394330:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836707.402225:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930176 00000100:00100000:0.0:1788836707.402241:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930176 00000100:00100000:0.0:1788836707.402357:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788836707.402370:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17913:x1875730782930176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836707.402408:0:17176:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788836707.402412:0:17176:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788836707.402419:0:17176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788836707.406701:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17913:x1875730782930176:12345-0@lo:253:mount.lustre.0 Request processed in 4326us (12460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836707.406725:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836707.406813:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836707.406827:0:17913:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788836707.406830:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836707.406832:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788836707.406833:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836707.406835:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836707.406836:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836707.406837:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836707.406839:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836707.406840:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836707.406842:0:17913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836707.406857:0:17913:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ade428c3000 from lustre-MDT0001 10000000:01000000:3.0:1788836707.406885:0:17913:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788836707.406897:0:17913:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788836707.406904:0:17913:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ade425419b8 local copy 00010000:00010000:3.0:1788836707.406915:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.407005:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836707.407070:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.411942:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.412679:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930304 00000100:00100000:1.0:1788836707.412689:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930304 00000100:00100000:1.0:1788836707.412741:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836707.412751:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17913:x1875730782930304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836707.422539:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17913:x1875730782930304:12345-0@lo:501:mount.lustre.0 Request processed in 9781us (15459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836707.422555:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836707.422682:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788836707.422709:0:17913:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788836707.422738:0:17913:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788836707.422748:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.422778:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.422813:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ade428c3000 10000000:01000000:3.0:1788836707.422818:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836707.422824:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ade425419b8 10000000:01000000:3.0:1788836707.422827:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788836707.422831:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ade425419b8 from 1 10000000:01000000:3.0:1788836707.422833:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788836707.422863:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.422871:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.422880:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.422913:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836707.422948:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.422987:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.424228:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930432 00000100:00100000:1.0:1788836707.424240:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930432 00000100:00100000:1.0:1788836707.424286:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788836707.424296:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+12:17913:x1875730782930432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.424310:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836707.424326:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae6c00/0xf7b38383a65551ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65551c3 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.424351:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae6c00/0xf7b38383a65551ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65551c3 expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.424362:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae6c00/0xf7b38383a65551ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65551c3 expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.424371:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6c00, rc 0) 00000100:00100000:1.0:1788836707.424437:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+13:17913:x1875730782930432:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.424444:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836707.424659:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836707.424675:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551ca expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.424685:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65551ca expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.424720:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788836707.424743:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551ca expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.424751:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701c00/0xf7b38383a65551c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551ca expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.424763:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ade428c3000 10000000:01000000:3.0:1788836707.424768:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788836707.424772:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ade428c3000 from 1 10000000:01000000:3.0:1788836707.424774:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788836707.424795:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.424803:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.424810:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.424828:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836707.424861:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.424885:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.425127:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930560 00000100:00100000:1.0:1788836707.425132:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930560 00000100:00100000:1.0:1788836707.425163:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836707.425169:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+13:17913:x1875730782930560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.425176:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836707.425185:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae6600/0xf7b38383a65551d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65551d1 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425210:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae6600/0xf7b38383a65551d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65551d1 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425218:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae6600/0xf7b38383a65551d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65551d1 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425224:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae6600, rc 0) 00000100:00100000:1.0:1788836707.425256:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+14:17913:x1875730782930560:12345-0@lo:101:mount.lustre.0 Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.425262:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836707.425294:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.425304:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551d8 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425311:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65551d8 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836707.425322:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788836707.425329:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551d8 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425335:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700800/0xf7b38383a65551d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551d8 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836707.425341:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788836707.425344:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836707.425349:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ade428c3000 10000000:01000000:1.0:1788836707.425357:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788836707.425360:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788836707.425362:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836707.425378:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425385:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425392:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836707.425404:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836707.425428:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.425448:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930688 00000100:00100000:1.0:1788836707.425451:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930688 00000100:00100000:1.0:1788836707.425484:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836707.425491:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+14:17913:x1875730782930688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.425499:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836707.425506:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae7e00/0xf7b38383a65551e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65551df expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425520:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae7e00/0xf7b38383a65551e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65551df expref: 15 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425528:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae7e00/0xf7b38383a65551e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65551df expref: 15 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425534:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7e00, rc 0) 00000100:00100000:1.0:1788836707.425557:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782930688:12345-0@lo:101:mount.lustre.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.425570:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836707.425597:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.425609:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.425618:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551e6 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.425626:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65551e6 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836707.429443:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788836707.430678:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836707.439348:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788836707.439405:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788836707.439421:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788836707.439437:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788836707.439452:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788836707.449476:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788836707.449542:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788836707.449555:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788836707.449567:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788836707.449577:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788836707.449588:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788836707.449601:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788836707.449612:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788836707.449622:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788836707.449633:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788836707.449643:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788836707.449654:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788836707.449664:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788836707.449675:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788836707.449686:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788836707.449698:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788836707.449709:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788836707.449720:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788836707.449744:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788836707.449749:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788836707.449858:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836707.452804:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836707.452860:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65981600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.453175:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930816 00000100:00100000:1.0:1788836707.453184:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930816 00000100:00100000:1.0:1788836707.453232:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836707.453240:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782930816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836707.453399:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782930816:12345-0@lo:501:mount.lustre.0 Request processed in 159us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.453407:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836707.453738:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836707.453791:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836707.453845:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.453884:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.453993:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782930944 00000100:00100000:1.0:1788836707.453997:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782930944 00000100:00100000:1.0:1788836707.454056:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836707.454064:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782930944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836707.454856:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782930944:12345-0@lo:503:mount.lustre.0 Request processed in 790us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.454865:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836707.454998:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782930944:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836707.455437:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836707.455588:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782931072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836707.455631:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836707.455671:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65981600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836707.455764:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931072 00000100:00100000:3.0:1788836707.455768:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931072 00000100:00100000:3.0:1788836707.455805:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836707.455812:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782931072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836707.457835:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782931072:12345-0@lo:502:mount.lustre.0 Request processed in 2014us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.457847:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836707.458033:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782931072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836707.458279:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788836707.458309:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788836707.458323:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788836707.458337:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788836707.458348:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788836707.458361:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788836707.458373:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788836707.458385:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788836707.458398:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788836707.458411:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788836707.458424:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788836707.458437:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788836707.458449:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788836707.458462:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788836707.458690:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788836707.458707:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788836707.458720:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788836707.458731:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788836707.458741:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788836707.458756:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788836707.458768:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788836707.458782:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788836707.458795:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788836707.458811:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788836707.458825:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788836707.458838:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788836707.458850:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788836707.458861:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788836707.458872:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788836707.458883:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788836707.458908:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788836707.458923:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788836707.458934:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788836707.458945:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788836707.458956:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788836707.458969:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788836707.458981:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788836707.458993:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788836707.459056:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788836707.459073:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788836707.459085:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788836707.459097:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788836707.459119:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788836707.459132:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788836707.459172:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782931200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.459708:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.459753:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aaba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836707.460877:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931200 00000100:00100000:0.0:1788836707.460898:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931200 00000100:00100000:0.0:1788836707.460962:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788836707.460973:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782931200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836707.461144:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782931200:12345-0@lo:502:mount.lustre.0 Request processed in 173us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836707.461152:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836707.461423:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782931200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836707.461522:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788836707.461537:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788836707.468928:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.469290:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.469294:0:17917:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788836707.469303:0:17917:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788836707.469306:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836707.469324:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8adf72c30000) 00000020:00000080:1.0:1788836707.469350:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788836707.469356:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788836707.469442:0:17917:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836707.469451:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a65551f4 00000020:00000080:1.0:1788836707.469736:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788836707.469741:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.469745:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.469747:0:17917:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788836707.469750:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.469754:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.469755:0:17917:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788836707.469758:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836707.469766:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8adf72c34d28) 00000020:00000080:1.0:1788836707.469779:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788836707.469783:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788836707.469785:0:17917:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788836707.469788:0:17917:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788836707.469793:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836707.469849:0:17917:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ade428c3000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788836707.469863:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8adf72c319b8) 00000020:00000080:1.0:1788836707.469872:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788836707.470422:0:17917:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788836707.470430:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6555209 00000020:00000080:1.0:1788836707.470552:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788836707.470560:0:17917:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788836707.470566:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf7b38383a6555210 00080000:01000000:1.0:1788836707.470573:0:17917:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788836707.470577:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6555217 00000100:00100000:0.0:1788836707.584420:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788836707.592362:0:17917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788836707.593603:0:17917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788836707.594676:0:17917:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788836707.597230:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788836707.597246:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836707.597254:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836707.597256:0:17917:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788836707.597261:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836707.597268:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836707.597269:0:17917:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788836707.597272:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836707.597279:0:17917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:00000080:3.0:1788836707.597312:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836707.597329:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8adf817b0000) 00000020:00000080:3.0:1788836707.597352:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788836707.597358:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836707.597430:0:17917:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788836707.597438:0:17917:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788836707.597447:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6555225 00010000:00080000:3.0:1788836707.597495:0:17917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf48aa7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836707.613366:0:17917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788836707.617870:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788836707.617897:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788836707.617940:0:17917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788836707.619843:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a655522c 00000100:00080000:1.0:1788836707.619856:0:17917:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836707.619863:0:17917:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8adf48aa7800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836707.619916:0:17917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428da300 x1875730782931328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836707.620054:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931328:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836707.620191:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836707.620279:0:17917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788836707.620364:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.620370:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620372:0:17917:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788836707.620376:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788836707.620379:0:17917:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788836707.620381:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836707.620382:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836707.620384:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788836707.620387:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620388:0:17917:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788836707.620391:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.620396:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620397:0:17917:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788836707.620401:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836707.620596:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931328 00000100:00100000:2.0:1788836707.620605:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931328 00000100:00100000:2.0:1788836707.620641:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836707.620649:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782931328:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788836707.620674:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1788836707.620740:0:17187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6555233 00000004:00100000:2.0:1788836707.620757:0:17187:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788836707.620764:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:01000000:1.0:1788836707.620899:0:17917:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788836707.620930:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.620935:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620936:0:17917:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788836707.620938:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788836707.620940:0:17917:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788836707.620952:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836707.620954:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836707.620955:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788836707.620958:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620959:0:17917:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788836707.620962:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788836707.620965:0:17917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788836707.620968:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.620969:0:17917:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788836707.620972:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788836707.620975:0:17917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1788836707.620996:0:17917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788836707.620999:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836707.621047:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8adf72c33370) 00000020:00000080:1.0:1788836707.621063:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788836707.621068:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788836707.621128:0:17917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788836707.621135:0:17917:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788836707.621140:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6555241 00010000:00080000:1.0:1788836707.621168:0:17917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf47f4b800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836707.621402:0:17917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788836707.621821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788836707.621827:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788836707.621838:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836707.621843:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1788836707.621847:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788836707.621852:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836707.621882:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77369500 x1875730782931456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:1.0:1788836707.627435:0:17917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788836707.627699:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788836707.629686:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836707.629962:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782931456:0@lo:38:kworker.0 00000100:00100000:0.0:1788836707.630196:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788836707.630359:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788836707.630520:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:3.0:1788836707.630845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836707.630851:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836707.630854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836707.630857:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836707.631087:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782931584:0@lo:400:kworker.0 00000100:00100000:3.0:1788836707.631135:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.631178:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931584 00000100:00100000:3.0:1788836707.631185:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931584 00000100:00100000:3.0:1788836707.631238:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836707.631247:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836707.631301:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782931584:12345-0@lo:400:kworker.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.631308:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836707.631349:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adf7736bb80 x1875730782931584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836707.631364:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782931584:0@lo:400:kworker.0 00000100:00080000:3.0:1788836707.633228:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8adf48aa5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836707.633324:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782931328:12345-0@lo:38:llog_process_th.0 Request processed in 12671us (13130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.633344:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836707.633367:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931456 00000100:00100000:3.0:1788836707.633374:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931456 00000100:00100000:0.0:1788836707.633440:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836707.633456:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788836707.633477:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788836707.633484:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836707.633487:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf48aa7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836707.633502:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931328:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788836707.638685:0:17922:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788836707.638694:0:17922:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788836707.639725:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836707.639736:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782931456:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788836707.639850:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875730782931456:12345-0@lo:38:kworker.0 Request processed in 114us (9655us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788836707.639857:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836707.640270:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836707.640279:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836707.640283:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788836707.640287:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782931456:0@lo:38:kworker.0 00000100:00100000:2.0:1788836707.640374:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782931712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836707.640420:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836707.640571:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782931712 00000100:00100000:0.0:1788836707.640578:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782931712 00000100:00100000:0.0:1788836707.640609:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836707.640615:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875730782931712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836707.640644:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836707.640689:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875730782931712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836707.640696:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836707.640774:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782931712:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1788836707.641149:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836707.641163:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836707.641205:0:17917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788836707.641228:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a6555248 00000100:00080000:0.0:1788836707.641236:0:17917:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836707.641241:0:17917:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8adf47f4b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836707.641266:0:17917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44708e00 x1875730782931840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836707.641301:0:17917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788836707.641350:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836707.641355:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.641357:0:17917:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788836707.641360:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836707.641363:0:17917:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788836707.641364:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836707.641366:0:17917:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836707.641368:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836707.641370:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.641371:0:17917:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836707.641373:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836707.641377:0:17917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788836707.641381:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.641382:0:17917:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788836707.641385:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836707.641388:0:17917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:0.0:1788836707.641409:0:17917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788836707.641412:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836707.641424:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8adf7fb83370) 00000020:00000080:0.0:1788836707.641439:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788836707.641444:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836707.642139:0:17917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788836707.642149:0:17917:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788836707.642157:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7b38383a6555256 00010000:00080000:0.0:1788836707.642196:0:17917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf772a9800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836707.642423:0:17917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1788836707.642590:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931840:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788836707.642639:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782931840 offset 0 length 520: 4 00000040:01000000:0.0:1788836707.642775:0:17917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788836707.642793:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788836707.646153:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836707.646163:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836707.646167:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836707.646170:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788836707.650483:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836707.650760:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788836707.650899:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788836707.651384:0:17924:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788836707.651389:0:17924:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788836707.652365:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836707.652378:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836707.652417:0:17917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836707.652439:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a655525d 00000100:00080000:0.0:1788836707.652451:0:17917:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836707.652457:0:17917:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836707.652608:0:17917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade4470b100 x1875730782931968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836707.652635:0:17917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788836707.652688:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836707.652691:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.652693:0:17917:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788836707.652696:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836707.652699:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.652701:0:17917:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836707.652704:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836707.652706:0:17917:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788836707.652707:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836707.652709:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.652710:0:17917:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788836707.652712:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836707.652714:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.652715:0:17917:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788836707.652718:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788836707.652743:0:17917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836707.652746:0:17917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836707.652747:0:17917:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788836707.652750:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1788836707.652909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836707.652923:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836707.652925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836707.652928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836707.653233:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836707.653301:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782931968 offset 0 length 520: 4 00000020:01000000:2.0:1788836707.653607:0:17913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788836707.653640:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788836707.653665:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551e6 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.653676:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7600/0xf7b38383a65551df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65551e6 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836707.653684:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade428c3000 from 1 10000000:01000000:2.0:1788836707.653687:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836707.653718:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.653726:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.653745:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836707.653760:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836707.653798:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836707.653824:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.653881:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932096 00000100:00100000:1.0:1788836707.653897:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932096 00000100:00100000:1.0:1788836707.653966:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836707.653976:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+15:17913:x1875730782932096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.653989:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836707.654001:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555264 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.654046:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555264 expref: 16 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.654057:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555264 expref: 16 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.654066:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7200, rc 0) 00000100:00100000:1.0:1788836707.654107:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17913:x1875730782932096:12345-0@lo:101:mount.lustre.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.654114:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836707.654160:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.654173:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.654182:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836707.654751:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932224:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788836707.654803:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.654823:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42775cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.654840:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932224 00000100:00100000:1.0:1788836707.654844:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932224 00000100:00100000:1.0:1788836707.654868:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836707.654874:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17913:x1875730782932224:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788836707.654890:0:17176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788836707.654906:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788836707.654909:0:17176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788836707.654979:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17913:x1875730782932224:12345-0@lo:256:mount.lustre.0 Request processed in 105us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.654986:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836707.655042:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932224:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788836707.655630:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836707.655639:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655648:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836707.655656:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade428c3000 from 1 10000000:01000000:1.0:1788836707.655658:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836707.655680:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655688:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655703:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836707.655717:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836707.655750:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.655772:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42c70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.655792:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932352 00000100:00100000:1.0:1788836707.655796:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932352 00000100:00100000:1.0:1788836707.655823:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836707.655830:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17913:x1875730782932352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.655838:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836707.655848:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555272 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655865:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655874:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655881:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43ae7a00, rc 0) 00000100:00100000:1.0:1788836707.655911:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932352:12345-0@lo:101:mount.lustre.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.655935:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836707.655969:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836707.655980:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836707.655993:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836707.656147:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836707.656177:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836707.656202:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.656215:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42c70000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.656228:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932480 00000100:00100000:1.0:1788836707.656231:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932480 00000100:00100000:1.0:1788836707.656252:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836707.656257:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836707.656339:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932480:12345-0@lo:501:mount.lustre.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.656345:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836707.656378:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836707.656400:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836707.656434:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.656447:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf42c70000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.656468:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932608 00000100:00100000:1.0:1788836707.656472:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932608 00000100:00100000:1.0:1788836707.656494:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836707.656499:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836707.656568:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932608:12345-0@lo:503:mount.lustre.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.656574:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836707.656619:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836707.656948:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836707.657036:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.657071:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.657088:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf412ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.657101:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932736 00000100:00100000:1.0:1788836707.657105:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932736 00000100:00100000:1.0:1788836707.657139:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836707.657146:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.657221:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932736:12345-0@lo:502:mount.lustre.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.657227:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836707.657265:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836707.657446:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788836707.670670:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788836707.670715:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788836707.670731:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788836707.670744:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788836707.670758:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788836707.670772:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788836707.670786:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788836707.670803:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788836707.670817:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788836707.670833:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788836707.670895:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836707.670998:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836707.671066:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.671197:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932864 00000100:00100000:1.0:1788836707.671206:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932864 00000100:00100000:1.0:1788836707.671255:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836707.671265:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.671380:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932864:12345-0@lo:502:mount.lustre.0 Request processed in 116us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.671388:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836707.671749:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836707.671813:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788836707.671824:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788836707.672541:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.672552:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672555:0:17926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788836707.672562:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ade428c3000 00000020:00000080:1.0:1788836707.672565:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836707.672572:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.672582:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672583:0:17926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788836707.672586:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.672589:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672590:0:17926:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788836707.672594:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ade428c3000 00000020:00000080:1.0:1788836707.672597:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836707.672656:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.672660:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672661:0:17926:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788836707.672663:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.672666:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672667:0:17926:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836707.672670:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ade428c3000 00000020:00000080:1.0:1788836707.672673:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836707.672690:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.672693:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672695:0:17926:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836707.672697:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836707.672700:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672701:0:17926:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788836707.672705:0:17926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ade428c3000 00000020:00000080:1.0:1788836707.672707:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836707.672730:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836707.672733:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836707.672734:0:17926:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788836707.672737:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788836707.674981:0:17913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788836707.675054:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836707.675078:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.675090:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.675146:0:17913:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788836707.675149:0:17913:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ade428c3000 10000000:01000000:3.0:1788836707.675152:0:17913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ade428c3000 10000000:01000000:3.0:1788836707.675155:0:17913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836707.675162:0:17913:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ade428c3000 from 1 10000000:01000000:3.0:1788836707.675165:0:17913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788836707.675201:0:17913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.675219:0:17913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.675230:0:17913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.675254:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836707.675320:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.675410:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836707.685588:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782932992 00000100:00100000:2.0:1788836707.685606:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782932992 00000100:00100000:2.0:1788836707.685678:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836707.685690:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17913:x1875730782932992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836707.685709:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836707.685731:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615c600/0xf7b38383a6555287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555280 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.685766:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615c600/0xf7b38383a6555287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555280 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.685788:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615c600/0xf7b38383a6555287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555280 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836707.685798:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c600, rc 0) 00000100:00100000:3.0:1788836707.686171:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782932992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836707.686189:0:17913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555287 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.686198:0:17913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555287 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836707.691570:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782932992:12345-0@lo:101:mount.lustre.0 Request processed in 5871us (16237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836707.691585:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:2.0:1788836707.696721:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788836707.697057:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836707.697282:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788836707.697305:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788836707.697319:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788836707.697331:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788836707.697345:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788836707.697358:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788836707.697370:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788836707.697381:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788836707.697393:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788836707.697406:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788836707.697418:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788836707.697429:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788836707.697440:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788836707.697649:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788836707.697667:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788836707.697678:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788836707.697688:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788836707.697699:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788836707.697709:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788836707.697719:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788836707.697730:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788836707.697748:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788836707.697759:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788836707.697770:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788836707.697780:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788836707.697790:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788836707.697800:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788836707.697810:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788836707.697826:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788836707.697830:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788836707.697918:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836707.697980:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836707.698157:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933120 00000100:00100000:2.0:1788836707.698164:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933120 00000100:00100000:2.0:1788836707.698243:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836707.698253:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836707.698357:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933120:12345-0@lo:501:mount.lustre.0 Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836707.698365:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836707.700404:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836707.700441:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836707.700513:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836707.700584:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836707.700618:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42ad0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.700732:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933248 00000100:00100000:1.0:1788836707.700739:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933248 00000100:00100000:1.0:1788836707.700789:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836707.700798:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836707.700917:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933248:12345-0@lo:503:mount.lustre.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.700931:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836707.700978:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836707.701411:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836707.701489:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.701525:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.701548:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933376 00000100:00100000:1.0:1788836707.701552:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933376 00000100:00100000:1.0:1788836707.701577:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836707.701583:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.701666:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933376:12345-0@lo:502:mount.lustre.0 Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.701674:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836707.701706:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.701719:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836707.701873:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788836707.701899:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788836707.701913:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788836707.701923:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788836707.701934:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788836707.701944:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788836707.701955:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788836707.701967:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788836707.701977:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788836707.701988:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788836707.702000:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788836707.702033:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788836707.702049:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788836707.702074:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788836707.702085:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788836707.702108:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788836707.702124:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788836707.702136:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788836707.702148:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788836707.702161:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788836707.702172:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788836707.702184:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788836707.702197:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788836707.702210:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788836707.702221:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788836707.702232:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788836707.702243:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788836707.702255:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788836707.702266:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788836707.702278:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788836707.702292:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788836707.702318:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788836707.702333:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788836707.702346:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788836707.702359:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788836707.702372:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788836707.702383:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788836707.702395:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788836707.702409:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788836707.702422:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788836707.702433:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788836707.702445:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788836707.702469:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788836707.702485:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788836707.702499:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788836707.702513:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788836707.702537:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788836707.702564:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788836707.702600:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.702641:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.702670:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933504 00000100:00100000:1.0:1788836707.702674:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933504 00000100:00100000:1.0:1788836707.702698:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788836707.702704:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.702775:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933504:12345-0@lo:502:mount.lustre.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.702781:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788836707.702813:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43aab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.702827:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836707.702954:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788836707.702974:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788836707.702994:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.703045:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836707.703064:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933632 00000100:00100000:1.0:1788836707.703068:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933632 00000100:00100000:1.0:1788836707.703087:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836707.703093:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836707.703148:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933632:12345-0@lo:502:mount.lustre.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.703153:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836707.703180:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf587ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.703193:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836707.703232:0:17913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788836707.703239:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788836707.706493:0:17931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788836707.706513:0:17931:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8adf48a1cd28) 00000020:00000080:0.0:1788836707.706538:0:17931:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788836707.706615:0:17931:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ade428c3000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788836707.706620:0:17931:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ade428c3000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788836707.706623:0:17931:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ade428c3000 3 00010000:00080000:0.0:1788836707.706654:0:17931:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adf433d6000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836707.715282:0:17931:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788836707.720712:0:17931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788836707.720761:0:17931:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836707.720778:0:17931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf7b38383a6555295 00000100:00080000:0.0:1788836707.720790:0:17931:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836707.720796:0:17931:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8adf433d6000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836707.720848:0:17931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44708380 x1875730782933760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836707.720893:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782933760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836707.720971:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836707.721056:0:17931:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788836707.721848:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933760 00000100:00100000:1.0:1788836707.721858:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933760 00000100:00100000:1.0:1788836707.721908:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836707.721917:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875730782933760:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788836707.722243:0:17181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:1.0:1788836707.722277:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf7b38383a655529c 00000004:00100000:1.0:1788836707.722293:0:17181:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836707.722336:0:17181:0:(import.c:65:import_set_state_nolock()) ffff8ade4252f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836707.722403:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875730782933760:12345-0@lo:38:llog_process_th.0 Request processed in 485us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.722411:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788836707.722436:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836707.722441:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836707.722444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836707.722447:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788836707.723106:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ade44708380 x1875730782933760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836707.723118:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836707.723124:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788836707.723131:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788836707.723135:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836707.723138:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf433d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836707.723143:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875730782933760:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788836707.726500:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1788836707.730484:0:17913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788836707.730541:0:17913:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836707.730567:0:17913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555287 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836707.730580:0:17913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700200/0xf7b38383a6555280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555287 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788836707.730647:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788836707.730650:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788836707.730651:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836707.730652:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836707.730654:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836707.730655:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836707.730657:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836707.730659:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836707.730660:0:17913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836707.730664:0:17913:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788836707.730667:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836707.730668:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788836707.730669:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836707.730670:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836707.730671:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836707.730673:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836707.730674:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836707.730675:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836707.730676:0:17913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836707.730705:0:17913:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788836707.730725:0:17913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788836707.730802:0:17913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836707.730843:0:17913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429beb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.732146:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782933888 00000100:00100000:1.0:1788836707.732160:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782933888 00000100:00100000:1.0:1788836707.732217:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836707.732227:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836707.732258:0:17175:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788836707.732273:0:17175:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788836707.749004:0:17161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788836707.749059:0:17175:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788836707.749080:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788836707.749373:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17913:x1875730782933888:12345-0@lo:253:mount.lustre.0 Request processed in 17142us (18565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.749386:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836707.749449:0:17913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17913:1875730782933888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788836707.749478:0:17913:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788836707.749482:0:17913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836707.749483:0:17913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788836707.749484:0:17913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836707.749485:0:17913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836707.749486:0:17913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836707.749488:0:17913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836707.749489:0:17913:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836707.749491:0:17913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836707.749492:0:17913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788836707.749509:0:17913:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788836707.752148:0:17197:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836707.752158:0:17197:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836707.752183:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752202:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752210:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555264 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752218:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752268:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752284:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 17 pid: 17175 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.752299:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782934016:0@lo:104: 00000100:00100000:3.0:1788836707.752362:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836707.752421:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752430:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.752438:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782934144:0@lo:104: 00000100:00100000:3.0:1788836707.752474:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.752497:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836707.752523:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934016 00000100:00100000:3.0:1788836707.752530:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934016 00000100:00100000:3.0:1788836707.752571:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934144 00000100:00100000:3.0:1788836707.752575:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934144 00000100:00100000:3.0:1788836707.752589:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836707.752597:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782934016:12345-0@lo:104: 00010000:00010000:3.0:1788836707.752609:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752656:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836707.752662:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782934016:12345-0@lo:104: Request processed in 65us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.752673:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836707.752692:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836707.752698:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782934144:12345-0@lo:104: 00010000:00010000:3.0:1788836707.752705:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752753:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836707.752758:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782934144:12345-0@lo:104: Request processed in 61us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.752764:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836707.752795:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782934016:0@lo:104: 00000100:00100000:3.0:1788836707.752804:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782934144:0@lo:104: 00010000:00010000:3.0:1788836707.752822:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752838:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836707.752844:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752850:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c400 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836707.752853:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752861:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836707.752867:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.752880:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836707.752907:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752913:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836707.752932:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752938:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf6615c400/0xf7b38383a6555264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655526b expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752950:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836707.752953:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752958:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836707.752961:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752968:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836707.752974:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836707.752979:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836707.752992:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.752998:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836707.753046:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753053:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65551a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65551a7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753068:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836707.753070:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836707.753072:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836707.753078:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836707.753095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782934272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836707.753122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.753143:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836707.753149:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782934400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836707.753168:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.753210:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934272 00000100:00100000:3.0:1788836707.753214:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934272 00010000:00010000:3.0:1788836707.753230:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 18 pid: 17175 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.753249:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934400 00000100:00100000:3.0:1788836707.753252:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934400 00010000:00010000:3.0:1788836707.753261:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 19 pid: 17174 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836707.753271:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836707.753276:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:3616:x1875730782934272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836707.753287:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836707.753293:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 19 pid: 17175 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753312:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 19 pid: 17175 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753325:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43ae7200/0xf7b38383a655526b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6555264 expref: 19 pid: 17175 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753337:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836707.753363:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3616:x1875730782934272:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.753369:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836707.753381:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836707.753387:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:3616:x1875730782934400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836707.753395:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836707.753398:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753406:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753415:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993600/0xf7b38383a65551a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65551a0 expref: 17 pid: 17174 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753425:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753433:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836707.753444:0:17166:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014212242s 00010000:00010000:3.0:1788836707.753454:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753475:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753481:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753487:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753492:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836707.753495:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753501:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753513:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753522:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836707.753546:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:3616:x1875730782934400:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.753551:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836707.753580:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782934400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836707.753589:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782934272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836707.753607:0:17197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753623:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836707.753630:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788836707.784079:0:17913:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788836707.784344:0:17938:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788836707.784349:0:17938:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788836707.784696:0:17939:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788836707.784714:0:17913:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788836707.788520:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836707.790523:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788836707.790603:0:17939:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788836707.805154:0:17940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788836707.805231:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836707.805286:0:17940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade429be3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836707.806332:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934528 00000100:00100000:3.0:1788836707.806344:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934528 00000100:00100000:3.0:1788836707.806403:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836707.806412:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934528:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.806525:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 114us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.806533:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836707.806582:0:17940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934528:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788836707.806616:0:17940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788836707.806652:0:17940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.806690:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.806713:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934656 00000100:00100000:3.0:1788836707.806717:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934656 00000100:00100000:3.0:1788836707.806734:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836707.806740:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934656:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.806850:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934656:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.806857:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836707.806876:0:17940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836707.806903:0:17940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.806971:0:17940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17940:1875730782934784:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.807000:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.807041:0:17940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836707.807317:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934784 00000100:00100000:1.0:1788836707.807323:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934784 00000100:00100000:1.0:1788836707.807357:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836707.807365:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17940:x1875730782934784:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788836707.807415:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17940:x1875730782934784:12345-0@lo:900:lod0001_rec0000.0 Request processed in 51us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836707.807423:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788836707.808627:0:17940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adf77369f80 x1875730782934784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836723 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836707.808642:0:17940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17940:1875730782934784:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.808710:0:17940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.808751:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836707.808787:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782934912 00000100:00100000:3.0:1788836707.808792:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782934912 00000100:00100000:3.0:1788836707.808823:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836707.808830:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934912:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836707.812080:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17940:x1875730782934912:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 3241us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836707.812097:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836707.812167:0:17940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836707.812200:0:17940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17940:1875730782934912:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788836707.812273:0:17940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788836707.813480:0:17913:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788836707.813522:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788836707.813930:0:17913:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788836707.813937:0:17913:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788836707.813974:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836707.821296:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788836707.824370:0:17940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000040:00080000:2.0:1788836707.824609:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788836707.824658:0:17913:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000004:00080000:3.0:1788836707.825575:0:17940:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788836707.825583:0:17940:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1788836707.825739:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788836707.829237:0:17913:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788836707.831682:0:17913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788836707.848484:0:17913:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788836707.848528:0:17913:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2ab05517988 00100000:10000000:2.0:1788836707.848537:0:17913:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788836707.849694:0:17913:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836707.849734:0:17913:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836707.849753:0:17913:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788836707.849770:0:17913:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788836707.850700:0:17913:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836707.850912:0:17913:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836708.095419:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836708.612092:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000040:00080000:2.0:1788836708.804245:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836709.132306:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836709.438173:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836709.438183:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade428c3000 from 8 10000000:01000000:3.0:1788836709.438188:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836709.438239:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836709.438252:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836709.438263:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836709.438290:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836709.438368:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836709.438417:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf433e33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836709.438556:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935040 00000100:00100000:0.0:1788836709.438565:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935040 00000100:00100000:0.0:1788836709.438618:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836709.438628:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17178:x1875730782935040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836709.438641:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836709.438661:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65552aa expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836709.438686:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65552aa expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836709.438696:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552aa expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836709.438705:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:0.0:1788836709.440049:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782935040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1417us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836709.440060:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788836709.445873:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836709.445906:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.445929:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836709.445998:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788836709.446088:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836709.446138:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65981600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836709.446283:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935168 00000100:00100000:0.0:1788836709.446291:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935168 00000100:00100000:0.0:1788836709.446347:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836709.446355:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782935168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836709.446375:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836709.446390:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836709.446393:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788836709.446488:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782935168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836709.446495:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788836709.447059:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788836709.447109:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836709.447117:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.447127:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836709.447138:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836709.447141:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade44565800 from 8 10000000:01000000:1.0:1788836709.447143:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836709.447173:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.447190:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.447199:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836709.447216:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836709.447249:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836709.447282:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf454480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836709.447357:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935296 00000100:00100000:3.0:1788836709.447364:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935296 00000100:00100000:3.0:1788836709.447409:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836709.447418:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782935296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836709.447445:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836709.447457:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65552b8 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836709.447477:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836709.447488:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836709.447502:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a701000, rc 0) 00000100:00100000:3.0:1788836709.447537:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782935296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836709.447543:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836709.448053:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836709.448069:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.448077:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836709.448122:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788836709.448155:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836709.448180:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf454480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836709.449442:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935424 00000100:00100000:3.0:1788836709.449456:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935424 00000100:00100000:3.0:1788836709.449505:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836709.449514:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782935424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788836709.449537:0:17176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836709.449553:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836709.449556:0:17176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788836709.449655:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782935424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836709.449663:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836709.450252:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782935424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788836709.450307:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836709.450317:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836709.450338:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836709.630142:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000040:00080000:0.0:1788836709.827822:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836710.149336:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836710.654404:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:1.0:1788836711.168281:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836711.682075:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00010000:00010000:1.0:1788836712.192616:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836712.708082:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 0 seconds 00000100:00100000:1.0:1788836712.712086:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836712.712116:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782935552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836712.712200:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836712.712324:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935552 00000100:00100000:0.0:1788836712.712333:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935552 00000100:00100000:0.0:1788836712.712411:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836712.712421:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782935552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836712.712453:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836712.712498:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782935552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836712.712505:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836712.712600:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782935552:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788836713.214234:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836713.214242:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788836713.214246:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836713.214258:0:13965:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8adf7a6bb800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836713.214282:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade428d8000 x1875730782935808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836713.214299:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836713.214303:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836713.214305:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836713.214308:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836713.214331:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836713.214334:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836713.214337:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836713.214339:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836713.214391:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782936192:0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214473:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.214528:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836713.214534:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782935680:0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214562:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.214599:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782935808:0@lo:38:kworker.0 00000100:00100000:1.0:1788836713.214624:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.214653:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782935936:0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.214692:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836713.214697:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782936064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.214749:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936192 00000100:00100000:1.0:1788836713.214756:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936192 00000100:00100000:1.0:1788836713.214795:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935936 00000100:00100000:1.0:1788836713.214799:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935936 00000100:00100000:1.0:1788836713.214814:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836713.214822:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782936192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214872:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782936192:12345-0@lo:400:kworker.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.214885:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836713.214902:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836713.214908:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782935936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.214939:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782935936:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.214945:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836713.214963:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935680 00000100:00100000:1.0:1788836713.214971:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935680 00000100:00100000:1.0:1788836713.214998:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836713.215004:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3614:x1875730782935680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.215064:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3614:x1875730782935680:12345-0@lo:400:kworker.0 Request processed in 60us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.215070:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836713.215100:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782935808 00000100:00100000:1.0:1788836713.215104:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782935808 00000100:00100000:1.0:1788836713.215116:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936064 00000100:00100000:1.0:1788836713.215118:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936064 00000100:00100000:1.0:1788836713.215132:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836713.215137:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875730782935808:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788836713.215158:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1788836713.215194:0:17187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a65552c6 00000004:00100000:1.0:1788836713.215208:0:17187:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788836713.215214:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788836713.215306:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782935680:0@lo:400:kworker.0 00010000:00080000:1.0:1788836713.215320:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade428d9880 x1875730782936192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836713.215330:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782936192:0@lo:400:kworker.0 00010000:00080000:1.0:1788836713.215358:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade428dbb80 x1875730782935936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836713.215377:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782935936:0@lo:400:kworker.0 00010000:00010000:1.0:1788836713.215781:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836713.228926:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8adf81459800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836713.229071:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782935808:12345-0@lo:38:kworker.0 Request processed in 13930us (14443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.229082:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836713.229110:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836713.229120:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782936064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836713.229180:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782936064:12345-0@lo:400:kworker.0 Request processed in 63us (14460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.229187:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836713.229234:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782936064:0@lo:400:kworker.0 00000100:00080000:2.0:1788836713.229841:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788836713.229851:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788836713.229857:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788836713.229860:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788836713.229875:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000acf08d79): req@ffff8adf77369c00 x1875730782928768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836713.229894:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782935808:0@lo:38:kworker.0 00000100:00100000:1.0:1788836713.229994:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836713.230006:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782936320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836713.230238:0:17223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836713.230264:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46125e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836713.230341:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.230386:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782928768 00000100:00100000:1.0:1788836713.230393:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782928768 00000100:00100000:1.0:1788836713.230423:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936320 00000100:00100000:1.0:1788836713.230426:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936320 00000100:00100000:1.0:1788836713.230439:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836713.230445:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17223:x1875730782928768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.230522:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17223:x1875730782928768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.230529:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836713.230544:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836713.230549:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782936320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836713.230570:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836713.230645:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782936320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.230664:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836713.230697:0:17223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17223:1875730782928768:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788836713.230729:0:17223:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788836713.230761:0:17223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17223:1875730782936448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.230802:0:17223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.230827:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45448cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836713.230839:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936448 00000100:00100000:1.0:1788836713.230842:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936448 00000100:00100000:1.0:1788836713.230858:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836713.230863:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17223:x1875730782936448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.230967:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17223:x1875730782936448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.230973:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836713.230999:0:17223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17223:1875730782936448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.231084:0:17223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17223:1875730782936576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.231106:0:17223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836713.231119:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45448cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836713.231131:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936576 00000100:00100000:1.0:1788836713.231134:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936576 00000100:00100000:1.0:1788836713.231149:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836713.231156:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17223:x1875730782936576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836713.231200:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17223:x1875730782936576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836713.231207:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836713.231244:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782936320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836713.231270:0:17223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17223:1875730782936576:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788836713.231304:0:17223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836713.233309:0:17223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788836713.236072:0:17223:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788836713.236091:0:17223:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1788836713.407968:0:18183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836714.240378:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836714.489885:0:18235:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836714.490355:0:18235:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836715.275673:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836715.663128:0:18285:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836715.663317:0:18285:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788836715.712715:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836716.290621:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836717.004620:0:18334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd21d3cee0 20000000:00000080:2.0:1788836717.004645:0:18334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adf470b9400 uarg=0000000000000000 20000000:01000000:2.0:1788836717.004684:0:18334:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788836717.004691:0:18334:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788836717.004696:0:18334:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788836717.011114:0:18335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788836717.011447:0:18334:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788836717.023159:0:18334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788836717.038698:0:18334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.038739:0:18334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655516f expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.038748:0:18334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.038756:0:18334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.038805:0:18334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.038821:0:18334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836717.038834:0:18334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18334:1875730782936704:0@lo:104: 00000100:00100000:1.0:1788836717.038954:0:18334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836717.039063:0:18334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.039072:0:18334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 17 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836717.039081:0:18334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18334:1875730782936832:0@lo:104: 00000100:00100000:1.0:1788836717.039104:0:18334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836717.039122:0:18334:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45448300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836717.039347:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936704 00000100:00100000:0.0:1788836717.039355:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936704 00000100:00100000:0.0:1788836717.039407:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936832 00000100:00100000:0.0:1788836717.039410:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936832 00000100:00100000:0.0:1788836717.039425:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836717.039434:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:18334:x1875730782936704:12345-0@lo:104: 00010000:00010000:0.0:1788836717.039447:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039495:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836717.039500:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:18334:x1875730782936704:12345-0@lo:104: Request processed in 68us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.039507:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836717.039524:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836717.039530:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:18334:x1875730782936832:12345-0@lo:104: 00010000:00010000:0.0:1788836717.039537:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039577:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836717.039582:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:18334:x1875730782936832:12345-0@lo:104: Request processed in 52us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.039588:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788836717.039602:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836717.039608:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039616:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae6800 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836717.039620:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039628:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836717.039635:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836717.039641:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836717.039682:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039689:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836717.039710:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039717:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43ae6800/0xf7b38383a6555272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555279 expref: -99 pid: 17913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039752:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836717.039756:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039762:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836717.039765:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039772:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836717.039779:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836717.039784:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836717.039798:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039805:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836717.039812:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039818:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701e00/0xf7b38383a655516f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555176 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.039832:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836717.039834:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836717.039835:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836717.039842:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836717.039860:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782936960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836717.039889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836717.039933:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836717.039939:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782937088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836717.039960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836717.040269:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782936960 00000100:00100000:0.0:1788836717.040275:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782936960 00010000:00010000:0.0:1788836717.040294:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 18 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836717.040321:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937088 00000100:00100000:0.0:1788836717.040324:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937088 00010000:00010000:0.0:1788836717.040336:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 19 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836717.040349:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836717.040355:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:3616:x1875730782936960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836717.040366:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836717.040371:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 19 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040381:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 19 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040409:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836717.040442:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:3616:x1875730782936960:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.040448:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836717.040463:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836717.040469:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3616:x1875730782937088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836717.040482:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836717.040487:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 18 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040496:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 18 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040508:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040516:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040529:0:17167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040537:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040544:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040550:0:17167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040555:0:17167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eaa00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836717.040558:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040565:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040583:0:17167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836717.040592:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836717.040614:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3616:x1875730782937088:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.040620:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836717.040654:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782937088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836717.040663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782936960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836717.041111:0:18334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43ae7a00/0xf7b38383a6555279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6555272 expref: 17 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836717.041124:0:18334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18334:1875730782936704:0@lo:104: 00010000:00010000:1.0:1788836717.041135:0:18334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43ae6e00/0xf7b38383a6555176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655516f expref: 16 pid: 17176 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836717.041144:0:18334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18334:1875730782936832:0@lo:104: 00010000:00010000:1.0:1788836717.041157:0:18334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.041165:0:18334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.041172:0:18334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836717.041178:0:18334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eaa00/0xf7b38383a65552cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836717.310280:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836707/real 1788836707] req@ffff8ade4470b100 x1875730782931968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836717 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836717.310344:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade4470b100 x1875730782931968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836717 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836717.310356:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836707/real 1788836707] req@ffff8ade44708e00 x1875730782931840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836717 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836717.310368:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade44708e00 x1875730782931840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836717 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836717.310410:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836717.310435:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836717.310440:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931968:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788836717.310446:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf47f4b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836717.310451:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836717.310454:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782931840:0@lo:8:llog_process_th.0 00010000:00010000:0.0:1788836717.310576:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836717.310672:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836717.310677:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836717.310679:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836717.310682:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836717.310711:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836717.310714:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836717.310717:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf47f4b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836717.310722:0:13965:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 491 00000100:00080000:2.0:1788836717.310727:0:13965:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836717.310733:0:13965:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8adf47f4b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836717.310752:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e3b80 x1875730782937728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836717.310764:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836717.310767:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836717.310769:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836717.310772:0:13965:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 491 00000100:00080000:2.0:1788836717.310775:0:13965:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836717.310778:0:13965:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836717.310789:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e3480 x1875730782937856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836717.310806:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782937472:0@lo:400:kworker.0 00000100:00100000:1.0:1788836717.310865:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782937216:0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.310872:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836717.310904:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836717.310927:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836717.310931:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782937984:0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.310932:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782937600:0@lo:400:kworker.0 00000100:00100000:1.0:1788836717.310953:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836717.310954:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836717.310971:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836717.310976:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782937344:0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.310984:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937216 00000100:00100000:0.0:1788836717.310991:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937216 00000100:00100000:1.0:1788836717.310996:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836717.311044:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937472 00000100:00100000:1.0:1788836717.311048:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937472 00000100:00100000:0.0:1788836717.311057:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788836717.311065:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:3614:x1875730782937216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836717.311069:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937984 00000100:00100000:1.0:1788836717.311071:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937984 00000100:00100000:1.0:1788836717.311082:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836717.311087:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782937472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.311109:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:3614:x1875730782937216:12345-0@lo:400:kworker.0 Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836717.311117:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782937472:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.311117:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788836717.311122:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836717.311133:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836717.311138:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782937984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.311145:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937600 00000100:00100000:0.0:1788836717.311147:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937600 00000100:00100000:1.0:1788836717.311163:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782937984:12345-0@lo:400:kworker.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.311163:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782937344 00000100:00100000:1.0:1788836717.311169:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836717.311171:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782937344 00000100:00100000:0.0:1788836717.311199:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836717.311205:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836717.311213:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782937216:0@lo:400:kworker.0 00010000:00080000:1.0:1788836717.311224:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e2d80 x1875730782937984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836717.311233:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782937600:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836717.311234:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782937984:0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.311239:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836717.311249:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836717.311255:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782937344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836717.311263:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782937600:0@lo:400:kworker.0 00010000:00080000:1.0:1788836717.311280:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e0e00 x1875730782937472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836717.311284:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875730782937344:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836717.311288:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782937472:0@lo:400:kworker.0 00000100:00100000:0.0:1788836717.311290:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836717.311324:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782937344:0@lo:400:kworker.0 00000100:00100000:3.0:1788836717.311501:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782937728:0@lo:8:kworker.0 00000400:00000100:3.0:1788836717.311529:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782937728 offset 0 length 520: 4 00000100:00100000:3.0:1788836717.311551:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782937856:0@lo:8:kworker.0 00000400:00000100:3.0:1788836717.311568:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782937856 offset 0 length 520: 4 00000100:00100000:0.0:1788836717.829374:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782938112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836717.829441:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836717.829494:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782938112 00000100:00100000:0.0:1788836717.829501:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782938112 00000100:00100000:0.0:1788836717.829549:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836717.829558:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782938112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836717.829592:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836717.829636:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782938112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836717.829643:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836717.829683:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782938112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836718.334529:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836703/real 1788836703] req@ffff8ade428d8700 x1875730782929920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836718 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836718.334576:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade428d8700 x1875730782929920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836718 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836718.334586:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836703/real 1788836703] req@ffff8ade428da680 x1875730782930048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836718 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836718.334598:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade428da680 x1875730782930048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836718 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836718.334617:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836718.334642:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836718.334646:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782929920:0@lo:8:kworker.0 00000100:00080000:0.0:1788836718.334652:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836718.334656:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836718.334659:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782930048:0@lo:8:kworker.0 00010000:00010000:0.0:1788836718.334688:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836718.336138:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782938240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836718.336204:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836718.336259:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782938240 00000100:00100000:1.0:1788836718.336267:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782938240 00000100:00100000:1.0:1788836718.336323:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836718.336331:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782938240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836718.336365:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836718.336406:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875730782938240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836718.336413:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836718.336452:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782938240:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1788836718.336528:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836718.336538:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade428c3000 from 13 10000000:01000000:2.0:1788836718.336541:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836718.336586:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.336597:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.336606:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836718.336622:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782938368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.336654:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.336688:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00080000:2.0:1788836718.336705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836718.336710:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836718.336713:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836718.336717:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1788836718.336721:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836718.336726:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adf7a4a7800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836718.336749:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e1c00 x1875730782938496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836718.336774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836718.336777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836718.336778:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836718.336782:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1788836718.336784:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836718.336788:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836718.336809:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e3100 x1875730782938624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836718.336844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836718.336848:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836718.336850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836718.336853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836718.336876:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782938752:0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.336907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.336939:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782938880:0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.336963:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.336981:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836718.336987:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782939008:0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337026:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.337053:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782938752 00000100:00100000:2.0:1788836718.337056:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782938752 00000100:00100000:2.0:1788836718.337081:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939008 00000100:00100000:2.0:1788836718.337084:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939008 00000100:00100000:2.0:1788836718.337096:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836718.337103:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782938752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337140:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782938752:12345-0@lo:400:kworker.0 Request processed in 38us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836718.337146:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836718.337160:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836718.337165:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782939008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337195:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782939008:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836718.337208:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836718.337224:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782938880 00000100:00100000:2.0:1788836718.337228:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782938880 00000100:00100000:2.0:1788836718.337246:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836718.337252:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782938880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337293:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782938880:12345-0@lo:400:kworker.0 Request processed in 40us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836718.337300:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788836718.337330:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e0000 x1875730782938752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836718.337340:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782938752:0@lo:400:kworker.0 00010000:00080000:2.0:1788836718.337361:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e0700 x1875730782939008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836718.337368:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782939008:0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337376:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782938880:0@lo:400:kworker.0 00000100:00100000:2.0:1788836718.337395:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782938496:0@lo:8:kworker.0 00000400:00000100:2.0:1788836718.337417:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782938496 offset 0 length 520: 4 00000100:00100000:2.0:1788836718.337435:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782938624:0@lo:8:kworker.0 00000400:00000100:2.0:1788836718.337449:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730782938624 offset 0 length 520: 4 00000100:00100000:1.0:1788836718.337531:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782938368 00000100:00100000:1.0:1788836718.337535:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782938368 00000100:00100000:1.0:1788836718.337575:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788836718.337582:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+16:17178:x1875730782938368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836718.337592:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836718.337604:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65552d4 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836718.337625:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836718.337635:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 17 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836718.337652:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836718.337682:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782938368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836718.337688:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836718.337886:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782938368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836718.337900:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.337917:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836718.337971:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.337998:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.338070:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836718.338490:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939136 00000100:00100000:1.0:1788836718.338495:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939136 00000100:00100000:1.0:1788836718.338560:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788836718.338582:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782939136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836718.338708:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782939136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836718.338715:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836718.338778:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.338811:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.338851:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.339236:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836718.339283:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939264 00000100:00100000:0.0:1788836718.339288:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939264 00000100:00100000:0.0:1788836718.339311:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836718.339317:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782939264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836718.339398:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782939264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836718.339405:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836718.339518:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836718.341989:0:18394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788836718.342141:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788836718.342163:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836718.342176:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.342187:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836718.342197:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836718.342200:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade44565800 from 13 10000000:01000000:2.0:1788836718.342203:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836718.342236:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.342245:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836718.342264:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836718.342295:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.342354:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.342389:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836718.342439:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939392 00000100:00100000:0.0:1788836718.342446:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939392 00000100:00100000:0.0:1788836718.342526:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788836718.342541:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+17:17178:x1875730782939392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836718.342554:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836718.342576:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65552e2 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836718.342601:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 18 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836718.342610:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 18 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836718.342618:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992400, rc 0) 00000100:00100000:0.0:1788836718.342662:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782939392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836718.342669:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836718.342769:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836718.342785:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836718.342795:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836718.342852:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836718.342877:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836718.356255:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf78644000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836718.357601:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939520 00000100:00100000:2.0:1788836718.357617:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939520 00000100:00100000:2.0:1788836718.357669:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836718.357679:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782939520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.358230:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782939520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 552us (15349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836718.358240:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836718.358318:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.358371:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.358435:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836718.358465:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836718.358479:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939648 00000100:00100000:2.0:1788836718.358483:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939648 00000100:00100000:2.0:1788836718.358504:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836718.358512:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782939648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836718.358610:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:17178:x1875730782939648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836718.358617:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836718.358662:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782939648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788836718.369331:0:18397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788836718.377967:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788836718.378029:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836718.378044:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836718.378055:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788836718.896212:0:17914:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1788836719.042424:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836719.358247:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836720.385463:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836721.407309:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836722.440376:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836722.942365:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782939776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836722.942501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836722.942667:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939776 00000100:00100000:0.0:1788836722.942674:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939776 00000100:00100000:0.0:1788836722.942763:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836722.942774:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782939776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836722.942820:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836722.942866:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782939776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836722.942875:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836722.946845:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782939776:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788836723.454707:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836723.454716:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836723.454730:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836723.454733:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836723.454751:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836723.454755:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836723.454757:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836723.454760:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836723.454800:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782940032:0@lo:400:kworker.0 00000100:00100000:2.0:1788836723.454899:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836723.454976:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836723.454982:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782940160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836723.455181:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782939904:0@lo:400:kworker.0 00000100:00100000:2.0:1788836723.455181:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836723.455276:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940160 00000100:00100000:2.0:1788836723.455287:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940160 00000100:00100000:1.0:1788836723.455324:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836723.455356:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836723.455370:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782940160:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788836723.455411:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836723.455929:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940032 00000100:00100000:0.0:1788836723.455938:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940032 00000100:00100000:0.0:1788836723.455984:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836723.455993:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836723.456601:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836723.456667:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782940416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836723.456695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836723.459164:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836723.459593:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836723.459613:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782940544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836723.459635:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782939904 00000100:00100000:3.0:1788836723.459651:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782939904 00000100:00100000:1.0:1788836723.459661:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836723.459726:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836723.459737:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3617:x1875730782939904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836723.459752:0:17186:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788836723.459765:0:17186:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788836723.459827:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:3617:x1875730782939904:12345-0@lo:400:kworker.0 Request processed in 92us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836723.459836:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836723.459870:0:17182:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836723.459877:0:17182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788836723.459919:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782939904:0@lo:400:kworker.0 00000100:00100000:3.0:1788836723.462566:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940416 00000100:00100000:3.0:1788836723.462576:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940416 00000100:00100000:3.0:1788836723.462616:0:17182:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836723.462629:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836723.462636:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836723.462717:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782940416:12345-0@lo:400:kworker.0 Request processed in 82us (6020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836723.462724:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836723.462964:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940288 00000100:00100000:1.0:1788836723.462976:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940288 00000100:00100000:0.0:1788836723.463004:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782940032:12345-0@lo:400:kworker.0 Request processed in 7007us (8100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836723.463038:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788836723.463149:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e1500 x1875730782940416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836723.463166:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782940416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836723.463180:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782940032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836723.463228:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940544 00000100:00100000:0.0:1788836723.463234:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940544 00000100:00100000:0.0:1788836723.463268:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836723.463279:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782940544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836723.463324:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836723.463627:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836723.463636:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782940288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836723.463696:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782940288:12345-0@lo:400:kworker.0 Request processed in 62us (4544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836723.463703:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836723.463739:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782940288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836723.463896:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782940544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 617us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836723.463907:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836723.464594:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782940544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836723.469638:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782940160:12345-0@lo:400:kworker.0 Request processed in 14263us (14454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836723.469654:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788836723.469713:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ade445e0000 x1875730782940160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836723.469734:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782940160:0@lo:400:kworker.0 00000020:01000004:3.0:1788836724.168150:0:18685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788836724.168154:0:18685:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788836724.168155:0:18685:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788836724.168405:0:18685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adf770e7800 00000020:01000004:3.0:1788836724.168428:0:18685:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788836724.168443:0:18685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788836724.168458:0:18685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8adf817b19b8) 00000020:00000080:3.0:1788836724.168473:0:18685:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836724.245863:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788836724.267946:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788836724.268702:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788836724.268994:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788836724.269384:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788836724.269834:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788836724.270224:0:18685:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788836724.271315:0:18685:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836724.271595:0:18685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788836724.271669:0:18685:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836724.271683:0:18685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7b38383a65552f7 00000020:01000004:3.0:1788836724.271690:0:18685:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788836724.271712:0:18685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836724.271715:0:18685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836724.271721:0:18685:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788836724.271726:0:18685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788836724.271738:0:18685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8adf817b3370) 00000020:00000080:3.0:1788836724.271749:0:18685:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788836724.275955:0:18685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836724.276796:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836724.276804:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788836724.279899:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788836724.279912:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788836724.290214:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836724.290228:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788836724.297904:0:18685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836724.298313:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836724.298319:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788836724.299205:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836724.299212:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788836724.331157:0:18685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836724.331465:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788836724.331471:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788836724.332950:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836724.332959:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788836724.340642:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836724.340654:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788836724.348135:0:18685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836724.348773:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788836724.348780:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788836724.349790:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836724.349802:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788836724.400115:0:18685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836724.400469:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836724.400475:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788836724.401508:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836724.401517:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788836724.401995:0:18685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788836724.402052:0:18685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788836724.402060:0:18685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788836724.419965:0:18685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836724.420029:0:18685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788836724.420034:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836724.420036:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.420038:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.420039:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.420041:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.420043:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.420044:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.420047:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.420049:0:18685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836724.420053:0:18685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788836724.420060:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836724.420062:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.420063:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.420064:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.420066:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.420067:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.420069:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.420070:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.420071:0:18685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836724.420097:0:18685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788836724.420118:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940672:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836724.420191:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.420328:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf58509480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836724.420532:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940672 00000100:00100000:1.0:1788836724.420539:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940672 00000100:00100000:1.0:1788836724.421047:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788836724.421060:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:18685:x1875730782940672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836724.421093:0:17174:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788836724.421097:0:17174:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788836724.421101:0:17174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788836724.422122:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:18685:x1875730782940672:12345-0@lo:253:mount.lustre.0 Request processed in 1062us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836724.422133:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836724.423530:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836724.423547:0:18685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836724.423551:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836724.423552:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.423554:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.423555:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.423556:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.423558:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.423559:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.423561:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.423563:0:18685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836724.423585:0:18685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adf770e7800 from lustre-OST0000 10000000:01000000:2.0:1788836724.423827:0:18685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788836724.423831:0:18685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788836724.423840:0:18685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ade425419b8 local copy 00010000:00010000:2.0:1788836724.423850:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836724.423945:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836724.423998:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.424071:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf58509f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836724.424246:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940800 00000100:00100000:1.0:1788836724.424254:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940800 00000100:00100000:1.0:1788836724.424299:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836724.424308:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:18685:x1875730782940800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836724.424391:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:18685:x1875730782940800:12345-0@lo:501:mount.lustre.0 Request processed in 84us (393us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836724.424399:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836724.424427:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788836724.424443:0:18685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788836724.424460:0:18685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788836724.424467:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.424476:0:18685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836724.424504:0:18685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf770e7800 10000000:01000000:2.0:1788836724.424510:0:18685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788836724.424517:0:18685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788836724.424520:0:18685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836724.424525:0:18685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788836724.424529:0:18685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836724.424552:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.424560:0:18685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.424569:0:18685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836724.424581:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836724.425470:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.425499:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf58509f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836724.425970:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782940928 00000100:00100000:1.0:1788836724.425979:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782940928 00000100:00100000:1.0:1788836724.426051:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836724.426059:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+18:18685:x1875730782940928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836724.426073:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836724.426088:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf429ea200/0xf7b38383a655530c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555305 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.426114:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea200/0xf7b38383a655530c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555305 expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.426125:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf429ea200/0xf7b38383a655530c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555305 expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.426134:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429ea200, rc 0) 00000100:00100000:1.0:1788836724.426191:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782940928:12345-0@lo:101:mount.lustre.0 Request processed in 133us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836724.426198:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836724.426287:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782940928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836724.426303:0:18685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655530c expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.426320:0:18685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655530c expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836724.430529:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788836724.431392:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836724.433136:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788836724.433188:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788836724.433204:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788836724.433685:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788836724.433715:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788836724.433815:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788836724.433843:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788836724.433849:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788836724.433988:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836724.434084:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836724.434132:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.434654:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941056 00000100:00100000:2.0:1788836724.434661:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941056 00000100:00100000:2.0:1788836724.434714:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836724.434722:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836724.434873:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941056:12345-0@lo:501:mount.lustre.0 Request processed in 151us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.434881:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836724.437278:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836724.437339:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836724.437412:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836724.437514:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836724.437626:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941184 00000100:00100000:1.0:1788836724.437633:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941184 00000100:00100000:1.0:1788836724.437680:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836724.437688:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836724.438572:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941184:12345-0@lo:503:mount.lustre.0 Request processed in 881us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836724.438581:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788836724.438698:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836724.439354:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836724.439441:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836724.439556:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836724.439704:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836724.439875:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941312 00000100:00100000:0.0:1788836724.439881:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941312 00000100:00100000:0.0:1788836724.439963:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836724.439972:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836724.440692:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941312:12345-0@lo:502:mount.lustre.0 Request processed in 719us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836724.440701:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788836724.440908:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836724.441141:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788836724.441184:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788836724.441202:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788836724.441214:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788836724.441228:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788836724.441252:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788836724.441265:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788836724.441276:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788836724.441293:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788836724.441305:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788836724.441316:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788836724.441328:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788836724.441354:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836724.441392:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836724.445716:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.446934:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941440 00000100:00100000:2.0:1788836724.446945:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941440 00000100:00100000:2.0:1788836724.447002:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836724.447034:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836724.447210:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941440:12345-0@lo:502:mount.lustre.0 Request processed in 199us (5817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.447218:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836724.447375:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836724.447454:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788836724.447469:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788836724.450083:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836724.450093:0:18702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788836724.450099:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836724.450101:0:18702:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788836724.450106:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836724.450121:0:18702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8adf7713b370) 00000020:00000080:3.0:1788836724.450144:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788836724.450149:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836724.450247:0:18702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf770e7800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788836724.450255:0:18702:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836724.450261:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7b38383a655531a 00010000:00010000:2.0:1788836724.455034:0:18702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788836724.455743:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788836724.457483:0:18702:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788836724.459053:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788836724.459064:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836724.459076:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459078:0:18702:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788836724.459082:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836724.459084:0:18702:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788836724.459086:0:18702:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836724.459088:0:18702:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836724.459089:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836724.459091:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459092:0:18702:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836724.459095:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836724.459098:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459099:0:18702:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836724.459102:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836724.459104:0:18702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836724.459106:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836724.459108:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459110:0:18702:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788836724.459112:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836724.459114:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459115:0:18702:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836724.459118:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788836724.459145:0:18702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836724.459147:0:18702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836724.459149:0:18702:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788836724.459152:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788836724.459946:0:18685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788836724.459980:0:18685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788836724.460009:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655530c expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.460037:0:18685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf6615cc00/0xf7b38383a6555305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655530c expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836724.460046:0:18685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf770e7800 from 1 10000000:01000000:3.0:1788836724.460057:0:18685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836724.460095:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.460104:0:18685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.460115:0:18685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836724.460140:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836724.460221:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836724.460261:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.461604:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941568 00000100:00100000:2.0:1788836724.461617:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941568 00000100:00100000:2.0:1788836724.461676:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836724.461686:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:18685:x1875730782941568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836724.461701:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836724.461717:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555321 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.461912:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555321 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.461934:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555321 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.461944:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d000, rc 0) 00000100:00100000:2.0:1788836724.462029:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941568:12345-0@lo:101:mount.lustre.0 Request processed in 327us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.462036:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788836724.464622:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836724.464653:0:18685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.464665:0:18685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836724.470417:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788836724.470961:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836724.472915:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788836724.472960:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788836724.472985:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788836724.472991:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788836724.473103:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836724.473185:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.473225:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836724.473253:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941696 00000100:00100000:0.0:1788836724.473260:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941696 00000100:00100000:0.0:1788836724.473303:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788836724.473313:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836724.473422:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941696:12345-0@lo:501:mount.lustre.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.473430:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788836724.476956:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836724.477031:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836724.477104:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.477149:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836724.477439:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941824 00000100:00100000:3.0:1788836724.477446:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941824 00000100:00100000:3.0:1788836724.477495:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836724.477504:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836724.477662:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941824:12345-0@lo:503:mount.lustre.0 Request processed in 159us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836724.477670:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836724.477679:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836724.478151:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836724.478250:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836724.478288:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836724.478303:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337240 going to sleep for 11 seconds 00010000:00010000:1.0:1788836724.479442:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836724.480986:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782941952 00000100:00100000:0.0:1788836724.480998:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782941952 00000100:00100000:0.0:1788836724.481069:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836724.481079:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836724.481244:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782941952:12345-0@lo:502:mount.lustre.0 Request processed in 165us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.481261:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836724.484100:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782941952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836724.484336:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788836724.484366:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788836724.484382:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788836724.484394:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788836724.484406:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788836724.484418:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788836724.484430:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788836724.484444:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788836724.484546:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788836724.484564:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788836724.484578:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788836724.484670:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836724.484898:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.484971:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.488976:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942080 00000100:00100000:2.0:1788836724.488991:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942080 00000100:00100000:2.0:1788836724.489158:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836724.489178:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782942080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836724.489356:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782942080:12345-0@lo:502:mount.lustre.0 Request processed in 188us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.489364:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788836724.489459:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836724.489551:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788836724.489565:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788836724.490533:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836724.490552:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490554:0:18706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788836724.490563:0:18706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf770e7800 00000020:00000080:1.0:1788836724.490566:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836724.490574:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836724.490576:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490578:0:18706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788836724.490580:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836724.490583:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490584:0:18706:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788836724.490588:0:18706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf770e7800 00000020:00000080:1.0:1788836724.490590:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836724.490798:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836724.490803:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490804:0:18706:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788836724.490807:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836724.490810:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490812:0:18706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836724.490815:0:18706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf770e7800 00000020:00000080:1.0:1788836724.490818:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836724.490836:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836724.490839:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490845:0:18706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836724.490848:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836724.490851:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490852:0:18706:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788836724.490856:0:18706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf770e7800 00000020:00000080:1.0:1788836724.490858:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836724.490884:0:18706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836724.490887:0:18706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836724.490888:0:18706:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788836724.490891:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788836724.498141:0:18685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788836724.498201:0:18685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836724.498220:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.498232:0:18685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836724.498291:0:18685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836724.498294:0:18685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf770e7800 10000000:01000000:2.0:1788836724.498297:0:18685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf770e7800 10000000:01000000:2.0:1788836724.498302:0:18685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836724.498307:0:18685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf770e7800 from 1 10000000:01000000:2.0:1788836724.498316:0:18685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836724.498351:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.498360:0:18685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.498371:0:18685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836724.498395:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836724.498521:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.498561:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836724.499772:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942208 00000100:00100000:3.0:1788836724.499784:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942208 00000100:00100000:3.0:1788836724.499853:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788836724.499862:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:18685:x1875730782942208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836724.499878:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836724.499892:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700e00/0xf7b38383a6555336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655532f expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.499917:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700e00/0xf7b38383a6555336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655532f expref: 21 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.499927:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700e00/0xf7b38383a6555336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655532f expref: 21 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836724.499935:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700e00, rc 0) 00000100:00100000:3.0:1788836724.500001:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942208:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836724.500008:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836724.500067:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836724.500082:0:18685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555336 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.500092:0:18685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555336 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836724.503585:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788836724.505130:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836724.505326:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788836724.505352:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788836724.505368:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788836724.505381:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788836724.505395:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788836724.505409:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788836724.505422:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788836724.506680:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788836724.507528:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788836724.507554:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788836724.507569:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788836724.507582:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788836724.507606:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788836724.507621:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788836724.507634:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788836724.507646:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788836724.507658:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788836724.507671:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788836724.507683:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788836724.507697:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788836724.507709:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788836724.507721:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788836724.507953:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788836724.507988:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788836724.508004:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788836724.508036:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788836724.508052:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788836724.508066:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788836724.508081:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788836724.508095:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788836724.508109:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788836724.508122:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788836724.508134:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788836724.508146:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788836724.508159:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788836724.508187:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788836724.508203:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788836724.508230:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788836724.508235:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788836724.508345:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836724.508419:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.508665:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.508687:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942336 00000100:00100000:2.0:1788836724.508694:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942336 00000100:00100000:2.0:1788836724.510884:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836724.510906:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836724.511097:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942336:12345-0@lo:501:mount.lustre.0 Request processed in 200us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.511105:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836724.511572:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836724.511635:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836724.511682:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.511718:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836724.516269:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942464 00000100:00100000:3.0:1788836724.516285:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942464 00000100:00100000:3.0:1788836724.518278:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788836724.518310:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836724.518490:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942464:12345-0@lo:503:mount.lustre.0 Request processed in 192us (6807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836724.518499:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836724.518580:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836724.519062:0:18685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836724.519148:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836724.519203:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.519231:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.519458:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942592 00000100:00100000:2.0:1788836724.519465:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942592 00000100:00100000:2.0:1788836724.519513:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788836724.519523:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836724.519619:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942592:12345-0@lo:502:mount.lustre.0 Request processed in 98us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.519626:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836724.522661:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836724.522929:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788836724.522964:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788836724.522980:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788836724.522993:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788836724.523006:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788836724.523053:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788836724.523069:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788836724.523082:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788836724.523094:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788836724.523106:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788836724.523118:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788836724.523131:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788836724.523144:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788836724.523155:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788836724.523165:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788836724.523191:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788836724.523205:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788836724.523219:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788836724.523231:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788836724.523244:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788836724.523256:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788836724.523283:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788836724.523296:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788836724.523310:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788836724.523322:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788836724.523333:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788836724.523345:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788836724.523359:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788836724.523371:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788836724.523382:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788836724.523394:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788836724.523406:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788836724.523428:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788836724.523442:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788836724.523470:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788836724.523484:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788836724.523497:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788836724.523524:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788836724.523538:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788836724.523550:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788836724.523564:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788836724.523577:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788836724.523590:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788836724.523604:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788836724.523618:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788836724.523630:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788836724.523642:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788836724.523653:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788836724.523696:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836724.523761:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.523800:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.526115:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942720 00000100:00100000:2.0:1788836724.526130:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942720 00000100:00100000:2.0:1788836724.526215:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788836724.526227:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836724.526389:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942720:12345-0@lo:502:mount.lustre.0 Request processed in 164us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.526396:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836724.526912:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836724.527135:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788836724.527162:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788836724.527206:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836724.527249:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.527284:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.528843:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942848 00000100:00100000:2.0:1788836724.528856:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942848 00000100:00100000:2.0:1788836724.528902:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836724.528912:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836724.529075:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782942848:12345-0@lo:502:mount.lustre.0 Request processed in 164us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.529084:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788836724.531180:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782942848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836724.531293:0:18685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788836724.531308:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788836724.535624:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788836724.535653:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ade425219b8) 00000020:00000080:1.0:1788836724.535677:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788836724.535772:0:18711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf770e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836724.535776:0:18711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf770e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836724.535779:0:18711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf770e7800 3 00010000:00080000:1.0:1788836724.535808:0:18711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade43827000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836724.539607:0:18711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788836724.539885:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788836724.539929:0:18711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836724.539941:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7b38383a6555344 00000100:00080000:1.0:1788836724.539951:0:18711:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836724.539956:0:18711:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ade43827000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836724.539990:0:18711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a757b80 x1875730782942976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836724.540030:0:18711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788836724.544808:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782942976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836724.544888:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836724.544995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.545000:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.545007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.545029:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.545057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.545060:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.545063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.545066:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836724.545139:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782943488:0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545178:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.545197:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836724.545202:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782943104:0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545226:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.545255:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782943232:0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.545307:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836724.545312:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782943360:0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545330:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.545357:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943104 00000100:00100000:0.0:1788836724.545364:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943104 00000100:00100000:0.0:1788836724.545401:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943360 00000100:00100000:0.0:1788836724.545405:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943360 00000100:00100000:0.0:1788836724.545420:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836724.545428:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782943104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545479:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782943104:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.545496:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836724.545514:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836724.545520:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782943360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.545553:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782943360:12345-0@lo:400:kworker.0 Request processed in 33us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.545558:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836724.545920:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782942976 00000100:00100000:2.0:1788836724.545925:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782942976 00000100:00100000:2.0:1788836724.545945:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943488 00000100:00100000:2.0:1788836724.545948:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943488 00000100:00100000:2.0:1788836724.545962:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943232 00000100:00100000:2.0:1788836724.545964:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943232 00000100:00100000:2.0:1788836724.545977:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836724.545982:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836724.546032:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782943488:12345-0@lo:400:kworker.0 Request processed in 50us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.546038:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836724.546054:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836724.546060:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782943232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836724.546088:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782943232:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.546093:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836724.546104:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836724.546107:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782942976:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788836724.546127:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1788836724.546178:0:17182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7b38383a655534b 00000004:00100000:2.0:1788836724.546195:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788836724.546228:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8ade4393c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836724.546268:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875730782942976:12345-0@lo:38:llog_process_th.0 Request processed in 159us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.546281:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836724.547794:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782943104:0@lo:400:kworker.0 00010000:00080000:0.0:1788836724.547814:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade44708380 x1875730782943488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836724.547825:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782943488:0@lo:400:kworker.0 00000100:00100000:0.0:1788836724.547863:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782943360:0@lo:400:kworker.0 00010000:00080000:0.0:1788836724.547876:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade4470aa00 x1875730782943232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836724.547886:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4470aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782943232:0@lo:400:kworker.0 00010000:00080000:0.0:1788836724.547912:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a757b80 x1875730782942976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836724.547921:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836724.547928:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788836724.547937:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836724.547941:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836724.547944:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade43827000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836724.547950:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875730782942976:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788836724.549159:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788836724.549241:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ade42524d28) 00000020:00000080:1.0:1788836724.549262:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788836724.549341:0:18711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf770e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836724.549345:0:18711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf770e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836724.549348:0:18711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf770e7800 3 00010000:00080000:1.0:1788836724.549377:0:18711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade43826800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788836724.552862:0:18711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788836724.553060:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788836724.553116:0:18711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836724.553129:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf7b38383a6555359 00000100:00080000:1.0:1788836724.553140:0:18711:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836724.553146:0:18711:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ade43826800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836724.553191:0:18711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a755c00 x1875730782943616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836724.553217:0:18711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788836724.553672:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782943616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836724.553752:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836724.553813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.553818:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.553821:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.553824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.553828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.553831:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836724.553833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836724.553836:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788836724.554221:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788836724.554371:0:18685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788836724.554402:0:18685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836724.554415:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555336 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836724.554426:0:18685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf6615d400/0xf7b38383a655532f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555336 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836724.554471:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836724.554473:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.554475:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.554476:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.554477:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.554479:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.554480:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.554482:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.554483:0:18685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836724.554487:0:18685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788836724.554490:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836724.554491:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.554492:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.554493:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.554495:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.554496:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.554497:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.554498:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.554499:0:18685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836724.554515:0:18685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788836724.554526:0:18685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782943744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836724.554562:0:18685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836724.554579:0:18685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836724.555566:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943744 00000100:00100000:2.0:1788836724.555577:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943744 00000100:00100000:2.0:1788836724.555752:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788836724.555763:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782943744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788836724.555791:0:17175:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788836724.555805:0:17175:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788836724.555973:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943616 00000100:00100000:1.0:1788836724.555980:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943616 00000100:00100000:1.0:1788836724.556040:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836724.556047:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782943616:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788836724.556115:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1788836724.556152:0:17182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf7b38383a6555360 00000004:00100000:1.0:1788836724.556178:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836724.556211:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8ade43820800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836724.556278:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875730782943616:12345-0@lo:38:llog_process_th.0 Request processed in 230us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836724.556286:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788836724.556543:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755c00 x1875730782943616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836724.556566:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836724.557708:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788836724.557720:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836724.557874:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788836724.557878:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade43826800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836724.557886:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875730782943616:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788836724.561869:0:17175:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788836724.561889:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788836724.562048:0:17197:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788836724.562054:0:17197:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788836724.562075:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562096:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552aa expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562104:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562112:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562152:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562244:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 21 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836724.562259:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782943872:0@lo:104: 00000100:00100000:0.0:1788836724.562324:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836724.562371:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.562380:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 21 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836724.562389:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782944000:0@lo:104: 00000100:00100000:0.0:1788836724.562413:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.562428:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d78600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836724.562450:0:17165:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788836724.562475:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782943872 00000100:00100000:0.0:1788836724.562481:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782943872 00000100:00100000:0.0:1788836724.562514:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944000 00000100:00100000:0.0:1788836724.562517:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944000 00000100:00100000:0.0:1788836724.562531:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836724.562538:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782943872:12345-0@lo:104: 00010000:00010000:0.0:1788836724.562550:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563009:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836724.563034:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782943872:12345-0@lo:104: Request processed in 496us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.563042:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836724.563067:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836724.563074:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4383b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782944000:12345-0@lo:104: 00010000:00010000:0.0:1788836724.563082:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563116:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836724.563121:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4383b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782944000:12345-0@lo:104: Request processed in 48us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.563127:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788836724.563165:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836724.563183:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563191:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43ae7200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836724.563195:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563203:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836724.563211:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836724.563216:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836724.563241:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563247:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836724.563265:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563283:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7200/0xf7b38383a65552b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563295:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836724.563299:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563303:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:0.0:1788836724.563306:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563313:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836724.563319:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836724.563323:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836724.563337:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563342:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836724.563369:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563375:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a701200/0xf7b38383a65552aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.563386:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836724.563393:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836724.563395:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836724.563401:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836724.563413:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782944128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836724.563439:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.563492:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782944256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836724.563517:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836724.563549:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944128 00000100:00100000:0.0:1788836724.563553:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944128 00010000:00010000:0.0:1788836724.563569:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 22 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836724.563587:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944256 00000100:00100000:0.0:1788836724.563590:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944256 00010000:00010000:0.0:1788836724.564283:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 23 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836724.564300:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836724.564307:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:3615:x1875730782944128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836724.564318:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836724.564322:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 23 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564332:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 23 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564349:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836724.564383:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:3615:x1875730782944128:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.564390:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836724.564411:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836724.564418:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43926050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:3616:x1875730782944256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836724.564426:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836724.564430:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 22 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564438:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 22 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564459:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564468:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836724.564480:0:17166:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014212242s 00010000:00010000:0.0:1788836724.564485:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564491:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564497:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564503:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564508:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836724.564512:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564528:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564537:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836724.564546:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836724.564573:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43926050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:3616:x1875730782944256:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836724.565431:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836724.567175:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:18685:x1875730782943744:12345-0@lo:253:mount.lustre.0 Request processed in 9558us (10755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836724.567175:0:18685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:18685:1875730782943744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836724.567189:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 10000000:01000000:2.0:1788836724.567195:0:18685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836724.567198:0:18685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836724.567200:0:18685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836724.567201:0:18685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836724.567203:0:18685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836724.567204:0:18685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836724.567205:0:18685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836724.567206:0:18685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836724.567208:0:18685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836724.567210:0:18685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836724.567223:0:18685:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788836724.571531:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a701000/0xf7b38383a65552bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65552b8 expref: 20 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836724.571547:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782944256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836724.571554:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782943872:0@lo:104: 00000100:00100000:0.0:1788836724.571597:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782944128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836724.571715:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992a00/0xf7b38383a65552b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65552aa expref: 19 pid: 17174 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836724.571725:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782944000:0@lo:104: 00010000:00010000:1.0:1788836724.571745:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.571823:0:17197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.571831:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836724.571837:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43993000/0xf7b38383a6555367 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788836724.592192:0:18685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788836724.599096:0:18685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788836724.599108:0:18685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788836724.599147:0:18685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836724.599205:0:18685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836724.599224:0:18685:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788836724.599245:0:18685:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788836724.600249:0:18685:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836724.600438:0:18685:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788836725.486821:0:18765:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836725.487315:0:18765:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836725.515925:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836725.954406:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788836726.212783:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836726.212791:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade428c3000 from 9 10000000:01000000:0.0:1788836726.212796:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836726.212845:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.212859:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.212871:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836726.212897:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836726.213026:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836726.213085:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836726.213218:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944384 00000100:00100000:3.0:1788836726.213232:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944384 00000100:00100000:3.0:1788836726.213290:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788836726.213301:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+19:17178:x1875730782944384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836726.213314:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836726.213327:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655536e expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836726.213350:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655536e expref: 20 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836726.213361:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655536e expref: 20 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836726.213370:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf7a700600, rc 0) 00000100:00100000:3.0:1788836726.213410:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:17178:x1875730782944384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836726.213417:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836726.213576:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836726.213592:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.213600:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836726.213646:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788836726.213677:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836726.213705:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836726.213807:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944512 00000100:00100000:3.0:1788836726.213812:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944512 00000100:00100000:3.0:1788836726.213843:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788836726.213850:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:17178:x1875730782944512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788836726.213864:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836726.213880:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836726.213883:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788836726.213966:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:17178:x1875730782944512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836726.213974:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788836726.215185:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788836726.215249:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836726.215258:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.215268:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836726.215278:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836726.215280:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade44565800 from 9 10000000:01000000:0.0:1788836726.215283:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836726.215305:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.215313:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.215321:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836726.215349:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836726.215386:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836726.215421:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836726.215476:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944640 00000100:00100000:2.0:1788836726.215481:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944640 00000100:00100000:2.0:1788836726.215520:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836726.215528:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:17178:x1875730782944640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836726.215538:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836726.215549:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655537c expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836726.215577:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655537c expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836726.215587:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655537c expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836726.215606:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d800, rc 0) 00000100:00100000:2.0:1788836726.215645:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782944640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836726.215652:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788836726.215768:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836726.215779:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.215788:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836726.215822:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788836726.215847:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836726.215869:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e70180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836726.215925:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944768 00000100:00100000:3.0:1788836726.215930:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944768 00000100:00100000:3.0:1788836726.215968:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836726.215975:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782944768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788836726.215988:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836726.216002:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836726.216005:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788836726.216105:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782944768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836726.216112:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788836726.216247:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782944768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788836726.216285:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836726.216292:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.216299:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836726.527242:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836727.550999:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836728.062466:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836728.062490:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782944896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836728.062593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836728.062818:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782944896 00000100:00100000:1.0:1788836728.062826:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782944896 00000100:00100000:1.0:1788836728.062898:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836728.062908:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782944896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836728.062943:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788836728.062995:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782944896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836728.063002:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836728.063062:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782944896:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788836728.575178:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836728.584318:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782945024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836728.584404:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836728.584716:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945024 00000100:00100000:1.0:1788836728.584725:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945024 00000100:00100000:1.0:1788836728.584768:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836728.584776:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782945024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836728.584813:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836728.584857:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782945024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836728.584871:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836728.584916:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782945024:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788836729.284908:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788836729.602191:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836729.602199:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836729.602202:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836729.602204:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836729.602220:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836729.602224:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836729.602227:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836729.602230:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836729.602283:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782945152:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602358:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602398:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782945664:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602424:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602450:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836729.602455:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782945536:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602556:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602587:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782945280:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602608:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602624:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782945792:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602661:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836729.602666:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782945408:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602695:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782945920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602715:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836729.602742:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945152 00000100:00100000:2.0:1788836729.602749:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945152 00000100:00100000:2.0:1788836729.602795:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836729.602803:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3615:x1875730782945152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.602849:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3615:x1875730782945152:12345-0@lo:400:kworker.0 Request processed in 46us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836729.602855:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836729.602886:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945664 00000100:00100000:2.0:1788836729.602890:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945664 00000100:00100000:2.0:1788836729.602907:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945792 00000100:00100000:2.0:1788836729.602909:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945792 00000100:00100000:2.0:1788836729.602927:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945408 00000100:00100000:2.0:1788836729.602929:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945408 00000100:00100000:2.0:1788836729.602939:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945920 00000100:00100000:2.0:1788836729.602941:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945920 00000100:00100000:2.0:1788836729.602953:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836729.602958:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782945664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.603000:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875730782945664:12345-0@lo:400:kworker.0 Request processed in 41us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836729.603007:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788836729.604303:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836729.604310:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836729.604360:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836729.604387:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836729.604452:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782945792:12345-0@lo:400:kworker.0 Request processed in 70us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836729.604472:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836729.604492:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836729.604499:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782945408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836729.604529:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782945408:12345-0@lo:400:kworker.0 Request processed in 30us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836729.604535:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836729.604547:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836729.604554:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836729.604582:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782945920:12345-0@lo:400:kworker.0 Request processed in 29us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836729.604588:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836729.604610:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945536 00000100:00100000:0.0:1788836729.604616:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945536 00000100:00100000:0.0:1788836729.604640:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782945280 00000100:00100000:0.0:1788836729.604643:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782945280 00000100:00100000:0.0:1788836729.604655:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836729.604660:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782945536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836729.604690:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782945536:12345-0@lo:400:kworker.0 Request processed in 30us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836729.604695:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836729.604708:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836729.604714:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782945280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836729.604742:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782945280:12345-0@lo:400:kworker.0 Request processed in 27us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836729.604753:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788836729.605652:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463dad80 x1875730782945408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836729.605671:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782945408:0@lo:400:kworker.0 00010000:00080000:2.0:1788836729.605686:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463db800 x1875730782945920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836729.605695:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782945920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.605707:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782945280:0@lo:400:kworker.0 00010000:00080000:2.0:1788836729.605718:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463da300 x1875730782945792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836729.605727:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782945792:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.605772:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782945536:0@lo:400:kworker.0 00000100:00100000:2.0:1788836729.605783:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3615:1875730782945152:0@lo:400:kworker.0 00010000:00080000:2.0:1788836729.605794:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463d8e00 x1875730782945664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836729.605803:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875730782945664:0@lo:400:kworker.0 00010000:00010000:0.0:1788836729.605887:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836730.626301:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836731.351104:0:19055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836731.654810:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836732.524566:0:19107:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836732.524769:0:19107:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836732.682605:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836732.736133:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836717/real 1788836717] req@ffff8ade445e3b80 x1875730782937728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.736174:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e3b80 x1875730782937728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.736184:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836717/real 1788836717] req@ffff8ade445e3480 x1875730782937856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.736195:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e3480 x1875730782937856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836732.736215:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf47f4b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836732.736236:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836732.736240:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782937728:0@lo:8:kworker.0 00000100:00080000:2.0:1788836732.736245:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836732.736251:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836732.736254:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782937856:0@lo:8:kworker.0 00000100:00080000:2.0:1788836732.736337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836732.736341:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836732.736344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836732.736346:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836732.736369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836732.736373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836732.736375:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf47f4b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836732.736380:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1788836732.736385:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836732.736397:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8adf47f4b800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836732.736417:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf463da680 x1875730782946560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836732.736429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836732.736431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836732.736433:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836732.736436:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1788836732.736438:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836732.736441:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788836732.736452:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf463db800 x1875730782946688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836732.736489:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782946048:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736549:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736586:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782946816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736611:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736633:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836732.736638:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782946176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736663:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736680:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782946944:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736699:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782946304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736746:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736763:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782947072:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736781:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736808:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836732.736814:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782946432:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.736867:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946048 00000100:00100000:2.0:1788836732.736874:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946048 00000100:00100000:2.0:1788836732.736920:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788836732.736930:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3614:x1875730782946048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.736975:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3614:x1875730782946048:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.736983:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788836732.737047:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946816 00000100:00100000:2.0:1788836732.737051:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946816 00000100:00100000:2.0:1788836732.737072:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946944 00000100:00100000:2.0:1788836732.737075:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946944 00000100:00100000:2.0:1788836732.737098:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946304 00000100:00100000:2.0:1788836732.737101:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946304 00000100:00100000:2.0:1788836732.737110:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947072 00000100:00100000:2.0:1788836732.737113:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947072 00000100:00100000:2.0:1788836732.737127:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836732.737133:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782946816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737166:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782946816:12345-0@lo:400:kworker.0 Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737172:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836732.737184:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836732.737189:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782946944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737214:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782946944:12345-0@lo:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737219:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836732.737240:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836732.737245:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737277:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782946304:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737283:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836732.737295:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836732.737300:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782947072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737326:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782947072:12345-0@lo:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737331:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836732.737348:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946176 00000100:00100000:2.0:1788836732.737352:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946176 00000100:00100000:2.0:1788836732.737374:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946432 00000100:00100000:2.0:1788836732.737376:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946432 00000100:00100000:2.0:1788836732.737388:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836732.737393:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782946176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737422:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782946176:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737428:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836732.737438:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836732.737444:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782946432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737469:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782946432:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.737475:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788836732.737574:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836732.737578:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836732.737604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782946432:0@lo:400:kworker.0 00010000:00080000:2.0:1788836732.737623:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463d9500 x1875730782946304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.737632:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782946304:0@lo:400:kworker.0 00010000:00080000:2.0:1788836732.737641:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463daa00 x1875730782947072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.737648:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782947072:0@lo:400:kworker.0 00000100:00100000:2.0:1788836732.737675:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782946560:0@lo:8:kworker.0 00000100:00100000:2.0:1788836732.737722:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.737750:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782946688:0@lo:8:kworker.0 00000100:00100000:2.0:1788836732.737774:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.737805:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946560 00000100:00100000:2.0:1788836732.737809:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946560 00000100:00100000:2.0:1788836732.737824:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782946688 00000100:00100000:2.0:1788836732.737827:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782946688 00000100:00100000:2.0:1788836732.737837:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836732.737841:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875730782946560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788836732.737866:0:18690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788836732.737892:0:18690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a655538a 00002000:00100000:2.0:1788836732.737905:0:18690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ade43939800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788836732.737910:0:18690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788836732.737913:0:18690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788836732.738127:0:18690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788836732.738149:0:18690:0:(import.c:65:import_set_state_nolock()) ffff8ade4393a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836732.738183:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782946560:12345-0@lo:8:kworker.0 Request processed in 341us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.738196:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836732.738208:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836732.738211:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875730782946688:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788836732.738222:0:18690:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788836732.739098:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782946176:0@lo:400:kworker.0 00010000:00080000:1.0:1788836732.739117:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463d9180 x1875730782946944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836732.739126:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782946944:0@lo:400:kworker.0 00000100:00100000:1.0:1788836732.739134:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782946048:0@lo:400:kworker.0 00010000:00080000:1.0:1788836732.739144:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463dad80 x1875730782946816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836732.739152:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782946816:0@lo:400:kworker.0 00010000:00080000:1.0:1788836732.742571:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf463da680 x1875730782946560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836732.742587:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836732.742596:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788836732.742606:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788836732.742612:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788836732.742615:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf47f4b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788836732.742640:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788836732.742646:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782946560:0@lo:8:kworker.0 00000004:00080000:0.0:1788836732.742770:0:17922:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836732.742858:0:17922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 516648845840ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788836732.742865:0:17922:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788836732.743801:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782947200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836732.743863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788836732.743925:0:17923:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788836732.743945:0:17923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947328:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788836732.743973:0:17923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836732.743990:0:17923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836732.744039:0:18689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836732.744047:0:18689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788836732.744259:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947200 00000100:00100000:0.0:1788836732.744266:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947200 00000100:00100000:0.0:1788836732.745451:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836732.745464:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730782947200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836732.745492:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836732.753512:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730782947200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8042us (9638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836732.753526:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788836732.753572:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836732.757462:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736b100 x1875730782947200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836732.757501:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782947200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836732.757771:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875730782946688:12345-0@lo:8:kworker.0 Request processed in 19556us (19994us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836732.757783:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836732.757804:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947328 00000100:00100000:2.0:1788836732.757809:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947328 00000100:00100000:2.0:1788836732.757847:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836732.757854:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17923:x1875730782947328:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1788836732.760792:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836732.760802:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836732.760808:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782946688:0@lo:8:kworker.0 00002000:00080000:2.0:1788836732.761268:0:18690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788836732.761275:0:18690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788836732.761428:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17923:x1875730782947328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3572us (17452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836732.761439:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788836732.761970:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736ad80 x1875730782947328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836748 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836732.761984:0:17923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947328:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788836732.761995:0:17923:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788836732.762065:0:17923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947456:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788836732.762104:0:17923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836732.762132:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947456 00000100:00100000:2.0:1788836732.762202:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947456 00000100:00100000:2.0:1788836732.762237:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836732.762246:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17923:x1875730782947456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788836732.762271:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788836732.762569:0:17923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496adc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836732.762584:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17923:x1875730782947456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 337us (478us total) trans 0 rc 0/0 00010000:00080000:3.0:1788836732.762588:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736ad80 x1875730782947456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836748 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836732.762597:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836732.762606:0:17923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947456:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788836732.762624:0:17923:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788836732.762652:0:17923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947584:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788836732.762681:0:17923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836732.762698:0:17923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836732.762738:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947584 00000100:00100000:3.0:1788836732.762741:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947584 00000100:00100000:3.0:1788836732.762762:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836732.762771:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17923:x1875730782947584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788836732.762796:0:18689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1788836732.763672:0:17914:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:1.0:1788836732.820509:0:18686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788836732.820523:0:18686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788836732.821569:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17923:x1875730782947584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58792us (58879us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788836732.821584:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788836732.821643:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736ad80 x1875730782947584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836748 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836732.821655:0:17923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788836732.821661:0:17923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17923:1875730782947584:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788836732.821677:0:17923:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788836732.821724:0:17923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17923:1875730782947712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788836732.821756:0:17923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836732.821788:0:17923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836732.821840:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947712 00000100:00100000:1.0:1788836732.821847:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947712 00000100:00100000:1.0:1788836732.821894:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836732.821903:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17923:x1875730782947712:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788836732.821965:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17923:x1875730782947712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836732.821973:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788836732.822003:0:17923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736ad80 x1875730782947712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836748 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836732.822040:0:17923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17923:1875730782947712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788836733.183176:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836733.183202:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782947840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836733.183278:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836733.192291:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947840 00000100:00100000:0.0:1788836733.192307:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947840 00000100:00100000:0.0:1788836733.193526:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836733.193543:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782947840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836733.193583:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836733.193668:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782947840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (10390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836733.193676:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836733.193743:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782947840:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788836733.414449:0:19158:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836733.414627:0:19158:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788836733.695092:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836733.695118:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782947968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836733.695190:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836733.695355:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836733.695544:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782947968 00000100:00100000:0.0:1788836733.695553:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782947968 00000100:00100000:0.0:1788836733.695656:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836733.695666:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782947968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836733.695708:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836733.695770:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782947968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836733.695787:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836733.695872:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782947968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788836734.718385:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836735.167857:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788836735.743614:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836736.767224:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836737.790900:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836737.790924:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782948096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836737.791008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836737.791340:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948096 00000100:00100000:3.0:1788836737.791348:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948096 00000100:00100000:3.0:1788836737.791402:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836737.791411:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782948096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836737.791439:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788836737.791480:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782948096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836737.791487:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788836737.793755:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836737.793762:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836737.793765:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836737.793768:0:13965:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836737.793792:0:13965:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836737.793795:0:13965:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836737.793799:0:13965:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836737.793805:0:13965:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1788836737.794729:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836737.794760:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782948480:0@lo:400:kworker.0 00000100:00100000:3.0:1788836737.794968:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836737.795024:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836737.795031:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782948352:0@lo:400:kworker.0 00000100:00100000:3.0:1788836737.795072:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836737.795359:0:13965:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788836737.795367:0:13965:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836737.795395:0:13965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a754380 x1875730782948736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836737.795450:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782948608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.795478:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795499:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788836737.795505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782948224:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.795531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795553:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782948864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.795574:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795598:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782948992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.795618:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795649:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836737.795655:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782949120:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.795675:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795700:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782948736:0@lo:8:kworker.0 00000100:00100000:1.0:1788836737.795723:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836737.795758:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948352 00000100:00100000:1.0:1788836737.795764:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948352 00000100:00100000:1.0:1788836737.795799:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948608 00000100:00100000:1.0:1788836737.795820:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948608 00010000:00010000:3.0:1788836737.796049:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836737.796063:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836737.796073:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782948352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836737.796351:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948480 00000100:00100000:2.0:1788836737.796356:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948480 00000100:00100000:2.0:1788836737.796375:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948864 00000100:00100000:2.0:1788836737.796377:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948864 00000100:00100000:2.0:1788836737.796398:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948992 00000100:00100000:2.0:1788836737.796400:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948992 00000100:00100000:2.0:1788836737.796416:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949120 00000100:00100000:2.0:1788836737.796418:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949120 00000100:00100000:2.0:1788836737.796441:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836737.796448:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782948480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836737.796479:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875730782948480:12345-0@lo:400:kworker.0 Request processed in 32us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836737.796486:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836737.796500:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836737.796505:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836737.796529:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782948864:12345-0@lo:400:kworker.0 Request processed in 24us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836737.796534:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836737.796543:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836737.796548:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782948992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836737.796569:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782948992:12345-0@lo:400:kworker.0 Request processed in 22us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836737.796575:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836737.796591:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836737.796595:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782949120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836737.796616:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782949120:12345-0@lo:400:kworker.0 Request processed in 21us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836737.796681:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836737.796697:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948736 00000100:00100000:2.0:1788836737.796700:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948736 00000100:00100000:2.0:1788836737.796717:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836737.796721:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782948736:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788836737.796739:0:19115:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836737.797088:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782948352:12345-0@lo:400:kworker.0 Request processed in 1017us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836737.797095:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836737.797581:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782948352:0@lo:400:kworker.0 00010000:00080000:3.0:1788836737.797594:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755180 x1875730782948480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836737.797618:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875730782948480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.797976:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836737.797987:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782948608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.798053:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782948608:12345-0@lo:400:kworker.0 Request processed in 71us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836737.798060:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836737.798080:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782948224 00000100:00100000:1.0:1788836737.798085:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782948224 00000100:00100000:1.0:1788836737.798125:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788836737.798131:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3616:x1875730782948224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.798827:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3616:x1875730782948224:12345-0@lo:400:kworker.0 Request processed in 694us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836737.799135:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788836737.799393:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782948224:0@lo:400:kworker.0 00010000:00080000:1.0:1788836737.799410:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a757100 x1875730782948864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836737.799421:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782948864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836737.799432:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782948608:0@lo:400:kworker.0 00010000:00080000:1.0:1788836737.799470:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755f80 x1875730782949120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836737.799480:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782949120:0@lo:400:kworker.0 00010000:00080000:1.0:1788836737.799492:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755500 x1875730782948992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836737.799500:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782948992:0@lo:400:kworker.0 00000100:00080000:0.0:1788836737.808109:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836737.808119:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836737.813034:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf77368380 x1875730782948096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836737.813431:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782948096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836737.843614:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782948736:12345-0@lo:8:kworker.0 Request processed in 46881us (47879us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836737.843634:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788836737.843787:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836737.843793:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836737.843796:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782948736:0@lo:8:kworker.0 00000100:00100000:0.0:1788836738.302388:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782949248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836738.302460:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836738.302518:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949248 00000100:00100000:0.0:1788836738.302526:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949248 00000100:00100000:0.0:1788836738.302572:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836738.302580:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782949248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836738.302614:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836738.302655:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782949248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.302662:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836738.302707:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782949248:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788836738.814550:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836738.815705:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836718/real 1788836718] req@ffff8ade445e1c00 x1875730782938496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836738.815734:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e1c00 x1875730782938496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836738.815744:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836718/real 1788836718] req@ffff8ade445e3100 x1875730782938624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836738.815754:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ade445e3100 x1875730782938624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836738.815771:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836738.815785:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836738.815789:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782938496:0@lo:8:kworker.0 00000100:00080000:2.0:1788836738.815810:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836738.815816:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836738.815819:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782938624:0@lo:8:kworker.0 00000100:00100000:3.0:1788836738.816930:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836738.817004:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836738.817257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836738.817262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788836738.817265:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836738.817271:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1788836738.817276:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788836738.817282:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adf7a4a7800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836738.817302:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a755f80 x1875730782949632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836738.817318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836738.817322:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836738.817324:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836738.817327:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1788836738.817329:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788836738.817333:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836738.817354:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a754000 x1875730782949760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836738.817386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836738.817390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836738.817392:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836738.817395:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1788836738.817397:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788836738.817400:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788836738.817410:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf7a757480 x1875730782950144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836738.817469:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949376 00000100:00100000:1.0:1788836738.817477:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949376 00000100:00100000:1.0:1788836738.817521:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836738.817529:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782949376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836738.817561:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836738.817602:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782949376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836738.817609:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836738.817632:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782949504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836738.817661:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836738.817687:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782950400:0@lo:400:kworker.0 00000100:00100000:1.0:1788836738.817712:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836738.817732:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836738.817738:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782949888:0@lo:400:kworker.0 00000100:00100000:1.0:1788836738.817759:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836738.817775:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782950528:0@lo:400:kworker.0 00000100:00100000:1.0:1788836738.817793:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836738.817819:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782949632:0@lo:8:kworker.0 00000100:00100000:1.0:1788836738.817843:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836738.828290:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782949760:0@lo:8:kworker.0 00000100:00100000:1.0:1788836738.828367:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836738.828536:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949504 00000100:00100000:2.0:1788836738.828544:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949504 00000100:00100000:2.0:1788836738.828598:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788836738.828607:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3614:x1875730782949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836738.828664:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:3614:x1875730782949504:12345-0@lo:400:kworker.0 Request processed in 57us (11002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836738.828671:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836738.831220:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949632 00000100:00100000:0.0:1788836738.831235:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949632 00000100:00100000:0.0:1788836738.831300:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836738.831308:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875730782949632:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788836738.831362:0:18690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1788836738.831395:0:18690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a6555391 00002000:00100000:0.0:1788836738.831411:0:18690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8adf471d7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788836738.831415:0:18690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788836738.831418:0:18690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788836738.831491:0:18690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788836738.831516:0:18690:0:(import.c:65:import_set_state_nolock()) ffff8adf471d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836738.831595:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782949632:12345-0@lo:8:kworker.0 Request processed in 286us (13750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.831602:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836738.832323:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950400 00000100:00100000:0.0:1788836738.832329:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950400 00000100:00100000:0.0:1788836738.832377:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949888 00000100:00100000:0.0:1788836738.832381:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949888 00000100:00100000:0.0:1788836738.832392:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950528 00000100:00100000:0.0:1788836738.832394:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950528 00000100:00100000:0.0:1788836738.832406:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836738.832413:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782950400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.832461:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782950400:12345-0@lo:400:kworker.0 Request processed in 48us (14748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.832468:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836738.832481:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836738.832486:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782949888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.832514:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782949888:12345-0@lo:400:kworker.0 Request processed in 28us (14755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.832521:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836738.832532:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836738.832547:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782950528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.832578:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782950528:12345-0@lo:400:kworker.0 Request processed in 31us (14784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.832584:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836738.838134:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782950144:0@lo:8:kworker.0 00000100:00100000:1.0:1788836738.838203:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788836738.838270:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755f80 x1875730782949632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836738.838294:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836738.838304:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788836738.838314:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788836738.838319:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788836738.838323:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf7a4a7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788836738.838358:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788836738.838365:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782949632:0@lo:8:kworker.0 00010000:00080000:1.0:1788836738.838410:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a757100 x1875730782949888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836738.838420:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782949888:0@lo:400:kworker.0 00010000:00080000:1.0:1788836738.838430:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a754a80 x1875730782950528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836738.838438:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782950528:0@lo:400:kworker.0 00000100:00100000:1.0:1788836738.838448:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782949504:0@lo:400:kworker.0 00010000:00080000:1.0:1788836738.838459:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a755180 x1875730782950400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836738.838466:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782950400:0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.838798:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782949760 00000100:00100000:0.0:1788836738.838805:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782949760 00000100:00100000:0.0:1788836738.838835:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950144 00000100:00100000:0.0:1788836738.838838:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950144 00000100:00100000:0.0:1788836738.838851:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836738.838859:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782949760:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788836738.838881:0:19115:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836738.838942:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782949760:12345-0@lo:8:kworker.0 Request processed in 82us (10574us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836738.838950:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836738.838967:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836738.838971:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782950144:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788836738.838981:0:19115:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836738.839005:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875730782950144:12345-0@lo:8:kworker.0 Request processed in 32us (801us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836738.839029:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1788836738.839128:0:17206:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788836738.839158:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17206:1875730782950784:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788836738.839189:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836738.839221:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b4a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836738.839516:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950784 00000100:00100000:0.0:1788836738.839521:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950784 00000100:00100000:0.0:1788836738.839557:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836738.839563:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17206:x1875730782950784:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788836738.839783:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836738.842384:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836738.842395:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836738.842400:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782949760:0@lo:8:kworker.0 00000100:00080000:1.0:1788836738.842413:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836738.842417:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836738.842426:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782950144:0@lo:8:kworker.0 00000004:00080000:0.0:1788836738.842743:0:17205:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836738.842838:0:17205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 522748825643ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788836738.842845:0:17205:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788836738.842893:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782950016:0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.842970:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836738.843002:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782950656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836738.843064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836738.843088:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836738.843095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782950272:0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.843122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836738.843174:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836738.843202:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950272 00000100:00100000:0.0:1788836738.843282:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950272 00000100:00100000:0.0:1788836738.843329:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836738.843337:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782950272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836738.843459:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782950272:12345-0@lo:400:kworker.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836738.843467:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788836738.843505:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a754380 x1875730782950272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836738.843516:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782950272:0@lo:400:kworker.0 00002000:00080000:0.0:1788836738.844472:0:19115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788836738.844482:0:19115:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788836738.844489:0:19115:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:3.0:1788836738.845321:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950016 00000100:00100000:3.0:1788836738.845333:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950016 00000100:00100000:3.0:1788836738.845392:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950656 00000100:00100000:3.0:1788836738.845396:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950656 00000100:00100000:3.0:1788836738.845448:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836738.845459:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875730782950656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836738.845489:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788836738.845573:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875730782950656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836738.845579:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788836738.845628:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf444f8380 x1875730782950656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836738.845647:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782950656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836738.864483:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836738.864495:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782950016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836738.864587:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782950016:12345-0@lo:400:kworker.0 Request processed in 95us (21618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836738.864593:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1788836738.867486:0:17161:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:3.0:1788836738.867582:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7a756d80 x1875730782950016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836738.867599:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7a756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782950016:0@lo:400:kworker.0 00002000:00010000:3.0:1788836738.878332:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.878399:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.878419:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.878424:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.878430:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.878451:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.878463:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.878471:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.879300:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.879927:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.879936:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.879952:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.879957:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.879962:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.879990:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.879999:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.880008:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889442:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836738.889453:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889474:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.889477:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889486:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889505:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889510:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555398 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889523:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.889526:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889530:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.889532:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889536:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889541:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889550:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.889551:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.889552:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.889623:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836738.889629:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a655539f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.889983:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836738.890622:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836738.890631:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.890646:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:0.0:1788836738.890650:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836738.890658:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.890671:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.890680:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.890688:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.890740:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836738.891066:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836738.891072:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.891091:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:0.0:1788836738.891094:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836738.891099:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.891108:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.891116:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.891122:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892040:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836738.892050:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892060:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.892065:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892074:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892092:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892109:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc10164/0xf7b38383a65553a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892127:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.892131:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892138:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.892141:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892149:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892159:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.892167:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.892169:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.892171:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.892834:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788836738.892844:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65553ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836738.895429:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.895443:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.895459:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.895474:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.895483:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.895497:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.895507:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.895516:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.899728:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836738.899742:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.899756:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836738.899761:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.899773:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.899810:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.899992:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.899994:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.899996:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.901625:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836738.901638:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.901699:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.903660:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.903672:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.903689:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.903693:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.903700:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.903715:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.903735:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.903743:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.903764:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.904057:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.904063:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904071:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.904074:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.904078:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904087:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904094:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904101:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904132:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836738.904146:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836738.904151:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904159:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.904164:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904174:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904190:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904197:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a65553bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904277:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.904282:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904288:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.904291:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904310:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904320:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904327:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a65553c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904340:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.904342:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.904402:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.904654:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.904660:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904669:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.904672:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.904677:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904686:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904693:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904707:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904720:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836738.904728:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.904732:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904738:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.904741:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904748:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904757:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904764:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a65553c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.904776:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.904777:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.904779:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.905088:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.905180:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.905193:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.905201:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.905204:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.905617:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.905628:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.905636:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.905642:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.905704:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.906043:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.906049:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.906059:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.906062:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.906066:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.906075:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.906090:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.906097:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911056:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836738.911072:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911086:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836738.911091:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911127:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911150:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911158:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a65553d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911221:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836738.911226:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911233:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836738.911236:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911245:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911255:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836738.911262:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.911264:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.911270:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.914451:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836738.914467:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a65553d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836738.915438:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.915448:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.915465:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.915468:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.915475:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.915489:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.915499:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.915520:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.917108:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.917122:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.917135:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.917140:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.917165:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.917183:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.917438:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.917441:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.917443:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.918493:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836738.918505:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a65553de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836738.920314:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.920325:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.920340:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.920451:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.920466:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.920482:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.920492:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.920500:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.924319:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.924335:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.924360:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615de00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.924364:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.924376:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.924397:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.924406:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.924408:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.924410:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.924910:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836738.924928:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a65553e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.925080:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836738.926408:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.926419:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.926433:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.926437:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.926443:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.926457:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.926480:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.926489:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.927295:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836738.929044:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.929056:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.929075:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.929079:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.929085:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.929098:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.929108:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.929116:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.930909:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836738.930934:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.930948:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615ce00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.930954:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.930967:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.930989:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.930996:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580000be/0xf7b38383a65553ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.931130:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.931135:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.931142:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.931145:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.931153:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.931171:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.931180:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.931182:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.931184:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.931907:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836738.931926:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a65553f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836738.932533:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.932541:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.932555:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.932560:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.932566:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.932578:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.932588:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.932596:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.932615:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836738.932916:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.932933:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.932942:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615dc00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.932946:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.932954:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.932973:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.932980:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1d1bcc/0xf7b38383a65553fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.932999:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.933001:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.933002:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836738.933111:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.933116:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.933129:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.933132:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.933137:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.933146:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.933155:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.933163:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.933912:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836738.934507:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.934516:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.934529:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.934533:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.934538:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.934550:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.934570:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.934578:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938635:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836738.938652:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938668:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615ca00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.938673:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938686:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938712:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938721:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a87138d5/0xf7b38383a6555401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938745:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.938749:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938755:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615de00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.938759:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938767:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938804:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.938812:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.938814:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.938816:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836738.943080:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.946963:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836738.946980:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000410063bc/0xf7b38383a6555408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836738.948359:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836738.948372:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.948389:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788836738.948394:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836738.948400:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.948415:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.948426:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.948449:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.948624:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.948631:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.948640:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.948645:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.948654:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.948671:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.948679:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.948681:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.948683:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.956786:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836738.956912:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f58b0f6/0xf7b38383a655540f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836738.957999:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.958027:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.958043:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.958048:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.958054:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.958068:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.958078:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.958085:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.961075:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.961090:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.961116:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.961121:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.961133:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.961154:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.961371:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.961374:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.961376:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.963044:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836738.963058:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555416 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836738.963752:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.963760:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.963774:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.963779:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.963786:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.964332:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.964342:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.964459:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.964503:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836738.964844:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836738.964852:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.964861:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836738.964866:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.964875:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.964896:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.964904:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcd9c0e8/0xf7b38383a655541d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836738.964940:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.964942:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836738.964944:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.966145:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.966156:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.966178:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.966183:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.966189:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.966201:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.967182:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.967877:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.967888:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.967910:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836738.968162:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.968168:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.968176:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.968181:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.968190:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970474:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970487:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d0010e/0xf7b38383a6555424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970681:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.970684:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.970686:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.970763:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.970770:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970783:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.970798:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.970805:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970817:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970826:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970832:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.970858:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836738.972676:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.972691:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.972704:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.972709:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.972720:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.972741:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.972748:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f1ba32/0xf7b38383a655542b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.972772:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.972774:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.972776:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.976040:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.976057:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976076:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.976088:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.976095:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976110:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976120:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976127:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976157:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.976667:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.976674:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976685:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.976688:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.976693:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976703:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976712:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976727:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976745:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836738.976758:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836738.976770:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976779:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.976784:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976794:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976815:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976823:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003861f538/0xf7b38383a6555432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976844:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836738.976847:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976864:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836738.976868:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976876:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976887:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976894:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be91eb8f/0xf7b38383a6555439 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.976905:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.976907:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836738.976909:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.977485:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.977493:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.977504:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.977508:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.977512:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.977522:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.977538:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.977546:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.977565:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.978002:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.978008:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978036:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.978039:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.978043:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978053:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978061:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978068:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978088:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836738.978150:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836738.978157:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978167:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a701a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836738.978171:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978180:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978194:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978202:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a47c120/0xf7b38383a6555440 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978224:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836738.978228:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978237:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836738.978240:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978250:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978260:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978267:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224baf26/0xf7b38383a6555447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.978358:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.978361:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.978363:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836738.978844:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.978851:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978862:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.978866:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.978870:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978879:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978887:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978895:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.978925:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836738.979314:0:19115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836738.979322:0:19115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.979331:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788836738.979340:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836738.979357:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.979539:0:19115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.979548:0:19115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.979557:0:19115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836738.979566:0:19115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788836738.979599:0:19115:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788836738.979719:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17206:x1875730782950784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 140151us (140524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836738.979728:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788836738.980572:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836738.980583:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980594:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836738.980616:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980626:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980648:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980656:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf7691c/0xf7b38383a655544e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980683:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836738.980686:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980692:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836738.980696:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980703:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980713:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980719:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000531058cf/0xf7b38383a6555455 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836738.980740:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.980741:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836738.980743:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836738.980939:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17206:1875730782950784:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788836738.980955:0:17206:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788836738.981005:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17206:1875730782950912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788836738.981087:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836738.981123:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf7863f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836738.981163:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782950912 00000100:00100000:2.0:1788836738.981171:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782950912 00000100:00100000:3.0:1788836738.981268:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836738.981281:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17206:x1875730782950912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788836738.981324:0:18690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788836738.981488:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788836738.992795:0:18686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788836738.992843:0:18686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788836738.993155:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17206:x1875730782950912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11871us (12062us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788836738.993169:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836738.993186:0:17206:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788836738.993196:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17206:1875730782950912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788836738.993214:0:17206:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:3.0:1788836739.531334:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836739.840697:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788836740.586846:0:19503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788836740.586850:0:19503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788836740.586852:0:19503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788836740.587047:0:19503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adf471d1000 00000020:01000004:0.0:1788836740.587067:0:19503:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788836740.587087:0:19503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788836740.587105:0:19503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8adf48a199b8) 00000020:00000080:0.0:1788836740.587127:0:19503:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788836740.684159:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788836740.692379:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788836740.692982:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788836740.694572:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788836740.695149:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788836740.696158:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788836740.699294:0:19503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788836740.700449:0:19503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836740.700650:0:19503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788836740.700665:0:19503:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836740.700677:0:19503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7b38383a6555463 00000020:01000004:3.0:1788836740.700683:0:19503:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788836740.700704:0:19503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836740.700707:0:19503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836740.700713:0:19503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788836740.700741:0:19503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788836740.700745:0:19503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788836740.719815:0:19503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836740.720182:0:19503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788836740.720187:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836740.720188:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788836740.720189:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836740.720190:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836740.720191:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836740.720193:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836740.720194:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836740.720195:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836740.720197:0:19503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836740.720201:0:19503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788836740.720203:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836740.720204:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788836740.720205:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836740.720206:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836740.720207:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836740.720208:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836740.720209:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836740.720210:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836740.720211:0:19503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836740.720240:0:19503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788836740.720261:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836740.721241:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836740.721295:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43a70540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836740.721400:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951040 00000100:00100000:1.0:1788836740.721410:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951040 00000100:00100000:1.0:1788836740.721473:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788836740.721484:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:19503:x1875730782951040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836740.721517:0:17176:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788836740.721528:0:17176:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788836740.721532:0:17176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788836740.721979:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:19503:x1875730782951040:12345-0@lo:253:mount.lustre.0 Request processed in 496us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.721988:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788836740.722195:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836740.722219:0:19503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788836740.722222:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836740.722223:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788836740.722224:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836740.722225:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836740.722226:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836740.722228:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836740.722229:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836740.722230:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836740.722231:0:19503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836740.722249:0:19503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adf471d1000 from lustre-OST0001 10000000:01000000:2.0:1788836740.722274:0:19503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788836740.722277:0:19503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788836740.722285:0:19503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ade425419b8 local copy 00010000:00010000:2.0:1788836740.722293:0:19503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836740.722395:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836740.722428:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836740.722449:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43a70c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836740.722501:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951168 00000100:00100000:0.0:1788836740.722506:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951168 00000100:00100000:0.0:1788836740.722543:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788836740.722551:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:19503:x1875730782951168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836740.722625:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:19503:x1875730782951168:12345-0@lo:501:mount.lustre.0 Request processed in 75us (195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836740.722639:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788836740.723636:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951168:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788836740.723654:0:19503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788836740.723686:0:19503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788836740.723693:0:19503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.723702:0:19503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43ae7400/0xf7b38383a65550b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65550b9 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836740.723729:0:19503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adf471d1000 10000000:01000000:1.0:1788836740.723734:0:19503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836740.723739:0:19503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788836740.723742:0:19503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836740.723755:0:19503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788836740.723758:0:19503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836740.723784:0:19503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.723791:0:19503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.723799:0:19503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.723814:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836740.723850:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.723907:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.724003:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951296 00000100:00100000:2.0:1788836740.724008:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951296 00000100:00100000:2.0:1788836740.724056:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788836740.724063:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:19503:x1875730782951296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836740.724074:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836740.724088:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615c400/0xf7b38383a6555471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655546a expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.724109:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615c400/0xf7b38383a6555471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655546a expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.724118:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615c400/0xf7b38383a6555471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655546a expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.724133:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c400, rc 0) 00000100:00100000:2.0:1788836740.724172:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951296:12345-0@lo:101:mount.lustre.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.724178:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788836740.724437:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836740.724451:0:19503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555471 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.724460:0:19503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555471 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836740.725670:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788836740.726492:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836740.729263:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788836740.730286:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788836740.730338:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788836740.730354:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788836740.730368:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788836740.730383:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788836740.730414:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788836740.730431:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788836740.730537:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836740.730603:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.730653:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.730741:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951424 00000100:00100000:2.0:1788836740.730749:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951424 00000100:00100000:2.0:1788836740.730801:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788836740.730811:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836740.730972:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951424:12345-0@lo:501:mount.lustre.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.730980:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788836740.731411:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836740.731445:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836740.731485:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.731514:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836740.731562:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951552 00000100:00100000:0.0:1788836740.731567:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951552 00000100:00100000:0.0:1788836740.731601:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788836740.731609:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836740.732296:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951552:12345-0@lo:503:mount.lustre.0 Request processed in 685us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836740.732305:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836740.732450:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836740.732844:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836740.732919:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836740.732957:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.732992:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5109ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.733094:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951680 00000100:00100000:3.0:1788836740.733100:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951680 00000100:00100000:3.0:1788836740.733141:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788836740.733149:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836740.733746:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951680:12345-0@lo:502:mount.lustre.0 Request processed in 596us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.733754:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836740.733843:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836740.734099:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788836740.734125:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788836740.734140:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788836740.734152:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788836740.734164:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788836740.734176:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788836740.734191:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788836740.734204:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788836740.734217:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788836740.734243:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836740.734285:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.734305:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b4a3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.734422:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951808 00000100:00100000:3.0:1788836740.734427:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951808 00000100:00100000:3.0:1788836740.734449:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788836740.734456:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836740.734537:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951808:12345-0@lo:502:mount.lustre.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.734544:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836740.734776:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836740.734814:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788836740.734821:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788836740.735583:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836740.735591:0:19507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788836740.735597:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836740.735599:0:19507:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788836740.735604:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836740.735619:0:19507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8adf442a4d28) 00000020:00000080:2.0:1788836740.735975:0:19507:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788836740.735985:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788836740.736251:0:19507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf471d1000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788836740.736261:0:19507:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788836740.736268:0:19507:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7b38383a655547f 00010000:00010000:1.0:1788836740.746490:0:19507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788836740.747041:0:19507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788836740.748849:0:19507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788836740.750811:0:19507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788836740.750830:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836740.750836:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836740.750838:0:19507:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788836740.750842:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836740.750846:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836740.750847:0:19507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788836740.750850:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788836740.750853:0:19507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788836740.750855:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836740.750857:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836740.750858:0:19507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788836740.750861:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836740.750863:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836740.750864:0:19507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788836740.750867:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788836740.750907:0:19507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836740.750910:0:19507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836740.750911:0:19507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788836740.750915:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788836740.756490:0:19503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788836740.756535:0:19503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788836740.756555:0:19503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555471 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.756568:0:19503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eb400/0xf7b38383a655546a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555471 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836740.756577:0:19503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf471d1000 from 1 10000000:01000000:1.0:1788836740.756579:0:19503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836740.756614:0:19503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.756632:0:19503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.756643:0:19503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.756666:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836740.756723:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.756753:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45448780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.756824:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782951936 00000100:00100000:3.0:1788836740.756830:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782951936 00000100:00100000:3.0:1788836740.756876:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788836740.756884:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:19503:x1875730782951936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836740.756907:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836740.756922:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555486 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836740.756946:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836740.756957:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836740.756976:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f46c00, rc 0) 00000100:00100000:3.0:1788836740.757051:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782951936:12345-0@lo:101:mount.lustre.0 Request processed in 166us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.757058:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836740.757164:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782951936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836740.757179:0:19503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836740.757188:0:19503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836740.758857:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788836740.759173:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836740.759478:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788836740.759503:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788836740.759520:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788836740.759525:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788836740.759592:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836740.759777:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.759862:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65c459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.762414:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952064 00000100:00100000:3.0:1788836740.762427:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952064 00000100:00100000:3.0:1788836740.762518:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788836740.762528:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836740.762697:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952064:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.762705:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788836740.762780:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836740.762827:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836740.762882:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.763067:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf45448780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836740.763133:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952192 00000100:00100000:0.0:1788836740.763138:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952192 00000100:00100000:0.0:1788836740.763161:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788836740.763167:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836740.763254:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952192:12345-0@lo:503:mount.lustre.0 Request processed in 86us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836740.763260:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788836740.767305:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836740.767771:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836740.767872:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836740.767964:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.768145:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836740.768234:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952320 00000100:00100000:0.0:1788836740.768242:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952320 00000100:00100000:0.0:1788836740.768294:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788836740.768303:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836740.768419:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952320:12345-0@lo:502:mount.lustre.0 Request processed in 116us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836740.768432:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788836740.768596:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836740.768771:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788836740.768798:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788836740.768811:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788836740.768823:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788836740.768836:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788836740.768850:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788836740.768879:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788836740.768905:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788836740.768919:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788836740.768932:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788836740.768960:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788836740.768983:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836740.769055:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.769079:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.769162:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952448 00000100:00100000:3.0:1788836740.769167:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952448 00000100:00100000:3.0:1788836740.769234:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788836740.769242:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836740.769339:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952448:12345-0@lo:502:mount.lustre.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.769346:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836740.769510:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836740.769550:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788836740.769558:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788836740.771382:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836740.771394:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771396:0:19511:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788836740.771403:0:19511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf471d1000 00000020:00000080:1.0:1788836740.771406:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836740.771414:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836740.771417:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771418:0:19511:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788836740.771420:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836740.771423:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771424:0:19511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788836740.771428:0:19511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adf471d1000 00000020:00000080:1.0:1788836740.771430:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836740.771486:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836740.771490:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771491:0:19511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788836740.771493:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836740.771495:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771496:0:19511:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836740.771499:0:19511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf471d1000 00000020:00000080:1.0:1788836740.771507:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836740.771525:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836740.771528:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771529:0:19511:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836740.771531:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836740.771533:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771534:0:19511:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788836740.771537:0:19511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adf471d1000 00000020:00000080:1.0:1788836740.771539:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836740.771560:0:19511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836740.771564:0:19511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836740.771565:0:19511:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788836740.771568:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788836740.785089:0:19503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788836740.785138:0:19503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836740.785164:0:19503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836740.785176:0:19503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836740.785234:0:19503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836740.785237:0:19503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adf471d1000 10000000:01000000:0.0:1788836740.785240:0:19503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adf471d1000 10000000:01000000:0.0:1788836740.785244:0:19503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836740.785249:0:19503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adf471d1000 from 1 10000000:01000000:0.0:1788836740.785251:0:19503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836740.785291:0:19503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836740.785298:0:19503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836740.785309:0:19503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836740.785345:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836740.785410:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.785454:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43a70540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.787219:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952576 00000100:00100000:2.0:1788836740.787230:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952576 00000100:00100000:2.0:1788836740.787299:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788836740.787309:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:19503:x1875730782952576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836740.787429:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836740.787446:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615d200/0xf7b38383a655549b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555494 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.787501:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615d200/0xf7b38383a655549b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555494 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.787512:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615d200/0xf7b38383a655549b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555494 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836740.787520:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d200, rc 0) 00000100:00100000:2.0:1788836740.789459:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952576:12345-0@lo:101:mount.lustre.0 Request processed in 2143us (4039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.789472:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788836740.800550:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836740.800579:0:19503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655549b expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836740.800600:0:19503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655549b expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836740.801728:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788836740.802005:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836740.808259:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788836740.808300:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788836740.808345:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788836740.808366:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788836740.808391:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788836740.808428:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788836740.808453:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788836740.808473:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788836740.808501:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788836740.808520:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788836740.808537:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788836740.808562:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788836740.808581:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788836740.808687:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788836740.808719:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788836740.808745:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788836740.808775:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788836740.808794:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788836740.808820:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788836740.808840:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788836740.808860:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788836740.808904:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788836740.808928:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788836740.808954:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788836740.808974:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788836740.808999:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788836740.809134:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788836740.809160:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788836740.810464:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788836740.810503:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788836740.810516:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788836740.810528:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788836740.810540:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788836740.810552:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788836740.810564:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788836740.810578:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788836740.810590:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788836740.810618:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788836740.810634:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788836740.810649:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788836740.810662:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788836740.810676:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788836740.810688:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788836740.810700:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788836740.810715:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788836740.810729:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788836740.810753:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788836740.810760:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788836740.810872:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836740.810952:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.813955:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.820493:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952704 00000100:00100000:3.0:1788836740.820509:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952704 00000100:00100000:3.0:1788836740.820575:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836740.820586:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836740.820758:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952704:12345-0@lo:501:mount.lustre.0 Request processed in 174us (9805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.820766:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788836740.822102:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836740.822158:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836740.822219:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.822253:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.823432:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952832 00000100:00100000:2.0:1788836740.823441:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952832 00000100:00100000:2.0:1788836740.823496:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788836740.823505:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836740.823816:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952832:12345-0@lo:503:mount.lustre.0 Request processed in 311us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.823825:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836740.824567:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952832:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836740.825001:0:19503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836740.825105:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836740.825157:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.825183:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836740.825621:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782952960 00000100:00100000:3.0:1788836740.825628:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782952960 00000100:00100000:3.0:1788836740.825717:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788836740.825726:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836740.825840:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782952960:12345-0@lo:502:mount.lustre.0 Request processed in 115us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.825848:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836740.825925:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782952960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836740.826153:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788836740.826180:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788836740.826195:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788836740.826223:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788836740.826240:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788836740.826252:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788836740.826264:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788836740.826276:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788836740.826288:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788836740.826300:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788836740.826398:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788836740.826420:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788836740.826431:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788836740.826442:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788836740.826455:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788836740.826466:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788836740.826478:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788836740.826489:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788836740.826501:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788836740.826526:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788836740.826541:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788836740.826553:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788836740.826564:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788836740.826576:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788836740.826588:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788836740.826611:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788836740.826624:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788836740.826635:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788836740.826646:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788836740.826657:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788836740.826668:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788836740.826679:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788836740.826692:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788836740.826704:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788836740.826717:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788836740.826744:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788836740.826760:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788836740.826771:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788836740.826783:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788836740.826796:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788836740.826808:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788836740.826822:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788836740.826836:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788836740.826848:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788836740.826861:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788836740.826874:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788836740.826900:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788836740.826917:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788836740.826958:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782953088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836740.827005:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.827608:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.827640:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953088 00000100:00100000:2.0:1788836740.827647:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953088 00000100:00100000:2.0:1788836740.827682:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788836740.827691:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782953088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836740.828462:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782953088:12345-0@lo:502:mount.lustre.0 Request processed in 770us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.828471:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788836740.830295:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782953088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836740.831621:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788836740.831655:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788836740.831706:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782953216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836740.831783:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.831828:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade42781000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836740.832059:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953216 00000100:00100000:2.0:1788836740.832066:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953216 00000100:00100000:2.0:1788836740.832129:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788836740.832138:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782953216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836740.832258:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782953216:12345-0@lo:502:mount.lustre.0 Request processed in 121us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836740.832266:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788836740.832385:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782953216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836740.832432:0:19503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788836740.832442:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788836740.835822:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788836740.835841:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adf48a18000) 00000020:00000080:0.0:1788836740.835867:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788836740.835994:0:19517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf471d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836740.835998:0:19517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf471d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836740.836000:0:19517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf471d1000 3 00010000:00080000:0.0:1788836740.836056:0:19517:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade438a0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836740.837559:0:19517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788836740.837714:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788836740.837742:0:19517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836740.837751:0:19517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7b38383a65554a9 00000100:00080000:0.0:1788836740.837759:0:19517:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836740.837763:0:19517:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ade438a0000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836740.837789:0:19517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44553480 x1875730782953344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836740.837823:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782953344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836740.837877:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.837951:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953344 00000100:00100000:0.0:1788836740.837958:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953344 00000100:00100000:0.0:1788836740.837990:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836740.837997:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875730782953344:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788836740.838041:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:0.0:1788836740.838068:0:17182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7b38383a65554b0 00000004:00100000:0.0:1788836740.838082:0:17182:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836740.838112:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8adf471d7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836740.838171:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875730782953344:12345-0@lo:38:llog_process_th.0 Request processed in 172us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836740.838178:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788836740.838216:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade44553480 x1875730782953344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836740.838225:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836740.838233:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788836740.838239:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836740.838244:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836740.838246:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade438a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836740.838251:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875730782953344:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788836740.838268:0:19517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788836740.841870:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782953472:0@lo:400:kworker.0 00000100:00100000:0.0:1788836740.841953:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.842047:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953472 00000100:00100000:1.0:1788836740.842056:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953472 00000100:00100000:1.0:1788836740.842114:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836740.842123:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782953472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788836740.842232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836740.842236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836740.842240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836740.842245:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:3.0:1788836740.842249:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788836740.842254:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836740.842273:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adf77369500 x1875730782953728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836740.842422:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782953472:12345-0@lo:400:kworker.0 Request processed in 299us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.842429:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788836740.842490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836740.842494:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836740.842496:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836740.842500:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:3.0:1788836740.842503:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788836740.842506:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836740.842520:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade445e3480 x1875730782954240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836740.842557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782953984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842588:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842628:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782954624:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842689:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836740.842696:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782954112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842746:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782953600:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842766:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842781:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782954368:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842818:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788836740.842823:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782953856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842841:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842856:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782954496:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842876:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.842922:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953984 00000100:00100000:3.0:1788836740.842927:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953984 00000100:00100000:3.0:1788836740.842953:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836740.842960:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782953984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.842998:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782953984:12345-0@lo:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843004:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836740.843044:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954112 00000100:00100000:3.0:1788836740.843048:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954112 00000100:00100000:3.0:1788836740.843082:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953600 00000100:00100000:3.0:1788836740.843085:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953600 00000100:00100000:3.0:1788836740.843103:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836740.843109:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782954112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843161:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782954112:12345-0@lo:400:kworker.0 Request processed in 52us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843167:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836740.843178:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836740.843183:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782953600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843212:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782953600:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843217:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836740.843238:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954624 00000100:00100000:3.0:1788836740.843242:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954624 00000100:00100000:3.0:1788836740.843258:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954368 00000100:00100000:3.0:1788836740.843260:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954368 00000100:00100000:3.0:1788836740.843269:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953856 00000100:00100000:3.0:1788836740.843271:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953856 00000100:00100000:3.0:1788836740.843280:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954496 00000100:00100000:3.0:1788836740.843282:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954496 00000100:00100000:3.0:1788836740.843294:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836740.843300:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782954624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843343:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782954624:12345-0@lo:400:kworker.0 Request processed in 43us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843349:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836740.843360:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836740.843366:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782954368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843390:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782954368:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843395:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836740.843405:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836740.843418:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782953856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843445:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782953856:12345-0@lo:400:kworker.0 Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843451:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836740.843462:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836740.843468:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782954496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843493:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782954496:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.843499:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836740.843536:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782954112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843546:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782953984:0@lo:400:kworker.0 00010000:00080000:3.0:1788836740.843557:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade445e0000 x1875730782954624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836740.843566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782954624:0@lo:400:kworker.0 00000100:00080000:3.0:1788836740.843587:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836740.843590:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836740.843593:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836740.843612:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adf7736ad80 x1875730782953856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836740.843620:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782953856:0@lo:400:kworker.0 00010000:00080000:3.0:1788836740.843628:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade445e0380 x1875730782954496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836740.843633:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782954496:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843653:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782953600:0@lo:400:kworker.0 00010000:00080000:3.0:1788836740.843661:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade445e3b80 x1875730782954368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836740.843668:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782954368:0@lo:400:kworker.0 00000100:00100000:3.0:1788836740.843690:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782953728:0@lo:8:kworker.0 00000100:00100000:3.0:1788836740.843723:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.843741:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782954240:0@lo:8:kworker.0 00000100:00100000:3.0:1788836740.843760:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.843782:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782953728 00000100:00100000:3.0:1788836740.843786:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782953728 00000100:00100000:3.0:1788836740.843800:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954240 00000100:00100000:3.0:1788836740.843803:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954240 00000100:00100000:3.0:1788836740.843813:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836740.843817:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782953728:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788836740.843862:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782953728:12345-0@lo:8:kworker.0 Request processed in 43us (139us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788836740.843869:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836740.843881:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836740.843894:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782954240:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788836740.843923:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782954240:12345-0@lo:8:kworker.0 Request processed in 36us (161us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788836740.843928:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836740.843952:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836740.843959:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836740.843962:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788836740.843971:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782953728:0@lo:8:kworker.0 00000100:00100000:3.0:1788836740.843982:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836740.843985:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836740.843988:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788836740.843990:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782954240:0@lo:8:kworker.0 00000100:00100000:0.0:1788836740.844281:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782953472:0@lo:400:kworker.0 00000020:01000004:0.0:1788836740.849213:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788836740.849231:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8adf48a1b370) 00000020:00000080:0.0:1788836740.849257:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788836740.849371:0:19517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adf471d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836740.849376:0:19517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adf471d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836740.849378:0:19517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adf471d1000 3 00010000:00080000:0.0:1788836740.849410:0:19517:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ade438a6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788836740.850989:0:19517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788836740.853779:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788836740.853828:0:19517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836740.853858:0:19517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf7b38383a65554be 00000100:00080000:0.0:1788836740.853875:0:19517:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836740.853881:0:19517:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ade438a6800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788836740.853930:0:19517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade44553100 x1875730782954752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836740.853951:0:19517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788836740.854155:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782954752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836740.854225:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836740.856415:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954752 00000100:00100000:0.0:1788836740.856430:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954752 00000100:00100000:0.0:1788836740.856480:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836740.856488:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875730782954752:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788836740.856559:0:18652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:0.0:1788836740.856593:0:18652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf7b38383a65554c5 00000004:00100000:0.0:1788836740.856608:0:18652:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836740.856642:0:18652:0:(import.c:65:import_set_state_nolock()) ffff8ade43781000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836740.856723:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875730782954752:12345-0@lo:38:llog_process_th.0 Request processed in 234us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836740.856731:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788836740.856834:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788836740.857003:0:19503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788836740.857051:0:19503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836740.857066:0:19503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655549b expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.857076:0:19503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8ade43992e00/0xf7b38383a6555494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655549b expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836740.857140:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836740.857143:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788836740.857144:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836740.857145:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836740.857147:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836740.857149:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836740.857150:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836740.857152:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836740.857154:0:19503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836740.857158:0:19503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788836740.857160:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836740.857162:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788836740.857163:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836740.857164:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836740.857165:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836740.857166:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836740.857167:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836740.857168:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836740.857169:0:19503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836740.857189:0:19503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788836740.857206:0:19503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782954880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836740.857248:0:19503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.857271:0:19503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850a80 going to sleep for 11 seconds 00010000:00080000:3.0:1788836740.861904:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ade44553100 x1875730782954752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836740.861920:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836740.861931:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788836740.861940:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788836740.861945:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788836740.861949:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ade438a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788836740.861955:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875730782954752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836740.862001:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782954880 00000100:00100000:3.0:1788836740.862007:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782954880 00000100:00100000:3.0:1788836740.862085:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836740.862094:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782954880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836740.862123:0:17176:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788836740.862137:0:17176:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1788836740.864091:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788836740.873179:0:17176:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788836740.873238:0:17176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788836740.873540:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:19503:x1875730782954880:12345-0@lo:253:mount.lustre.0 Request processed in 11443us (16287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836740.873565:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788836740.873688:0:19503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:19503:1875730782954880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788836740.873701:0:19503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788836740.873704:0:19503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836740.873706:0:19503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836740.873707:0:19503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836740.873708:0:19503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836740.873709:0:19503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836740.873711:0:19503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836740.873712:0:19503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836740.873714:0:19503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836740.873716:0:19503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788836740.873730:0:19503:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788836740.875756:0:19503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 20000000:01000000:1.0:1788836740.875979:0:17197:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788836740.875984:0:17197:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788836740.876005:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876047:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876055:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655537c expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876074:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876111:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876126:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 23 pid: 17174 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.876140:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782955008:0@lo:104: 00000100:00100000:1.0:1788836740.876199:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836740.876251:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876259:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.876267:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782955136:0@lo:104: 00000100:00100000:1.0:1788836740.876287:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.876305:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade438506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836740.876338:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955008 00000100:00100000:1.0:1788836740.876345:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955008 00000100:00100000:1.0:1788836740.876376:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955136 00000100:00100000:1.0:1788836740.876379:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955136 00000100:00100000:1.0:1788836740.876394:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836740.876401:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782955008:12345-0@lo:104: 00010000:00010000:1.0:1788836740.876413:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876478:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836740.876485:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:17197:x1875730782955008:12345-0@lo:104: Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.876492:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836740.876509:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836740.876515:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782955136:12345-0@lo:104: 00010000:00010000:1.0:1788836740.876522:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.876553:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836740.876557:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:17197:x1875730782955136:12345-0@lo:104: Request processed in 43us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.876562:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836740.876593:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782955008:0@lo:104: 00000100:00100000:1.0:1788836740.876602:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17197:1875730782955136:0@lo:104: 00010000:00010000:1.0:1788836740.876623:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877054:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836740.877061:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877069:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836740.877073:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877082:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836740.877096:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836740.877102:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836740.877137:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877143:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836740.877164:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877171:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43992c00/0xf7b38383a655537c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555383 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877183:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836740.877186:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877192:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993a00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:1.0:1788836740.877195:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877200:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836740.877206:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836740.877210:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836740.877231:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877236:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836740.877250:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877255:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8ade43993a00/0xf7b38383a655536e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555375 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.877266:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836740.877268:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836740.877269:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836740.877406:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836740.881323:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836740.881360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782955264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836740.881436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836740.881498:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782955392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836740.881521:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836740.883977:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955264 00000100:00100000:1.0:1788836740.883993:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955264 00010000:00010000:1.0:1788836740.884055:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 24 pid: 17174 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.884091:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955392 00000100:00100000:1.0:1788836740.884094:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955392 00010000:00010000:1.0:1788836740.884107:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 25 pid: 17176 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836740.884123:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836740.884131:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+25:3616:x1875730782955264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836740.884145:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836740.884150:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 25 pid: 17174 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884162:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 25 pid: 17174 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884188:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf6615d800/0xf7b38383a6555383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655537c expref: 25 pid: 17174 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884205:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836740.884269:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3616:x1875730782955264:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.884276:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836740.884293:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836740.884299:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:3614:x1875730782955392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836740.884307:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788836740.884427:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782955264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836740.884475:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884484:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884495:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf7a700600/0xf7b38383a6555375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a655536e expref: 23 pid: 17176 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884505:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884514:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836740.884528:0:17168:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014212242s 00010000:00010000:1.0:1788836740.884534:0:17168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884550:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884556:0:17168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884562:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884567:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836740.884571:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.884579:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788836740.884973:0:19503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788836740.884980:0:19503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788836740.885035:0:19503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788836740.885076:0:19503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788836740.885095:0:19503:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788836740.885112:0:19503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788836740.885939:0:19503:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836740.886195:0:19503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836740.898399:0:17197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836740.898416:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.905932:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.905953:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429ea800/0xf7b38383a65554cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836740.905979:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836740.906089:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:3614:x1875730782955392:12345-0@lo:103:ldlm_bl.0 Request processed in 21787us (24564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836740.906099:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836740.906463:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade42a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782955392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836741.887134:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836741.889669:0:19570:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836741.890207:0:19570:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788836742.591849:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836742.591868:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade428c3000 from 10 10000000:01000000:3.0:1788836742.591873:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836742.591927:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.591941:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.591953:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836742.591982:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836742.592104:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836742.592157:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836742.592846:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955520 00000100:00100000:2.0:1788836742.592865:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955520 00000100:00100000:2.0:1788836742.592923:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788836742.592932:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782955520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836742.592947:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836742.592962:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615dc00/0xf7b38383a65554da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65554d3 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836742.592987:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615dc00/0xf7b38383a65554da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65554d3 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836742.592998:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615dc00/0xf7b38383a65554da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65554d3 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836742.593008:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615dc00, rc 0) 00000100:00100000:2.0:1788836742.593073:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782955520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836742.593080:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788836742.593176:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836742.593192:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554da expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.593201:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65554da expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836742.593268:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836742.593317:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836742.593349:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836742.593583:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955648 00000100:00100000:2.0:1788836742.593588:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955648 00000100:00100000:2.0:1788836742.593621:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788836742.593627:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782955648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788836742.593641:0:17176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836742.593661:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836742.593664:0:17176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788836742.593734:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782955648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836742.593742:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788836742.597466:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788836742.597553:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836742.597563:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554da expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597575:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f47c00/0xf7b38383a65554d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554da expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836742.597587:0:17178:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836742.597590:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ade44565800 from 10 10000000:01000000:3.0:1788836742.597592:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836742.597627:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597636:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597657:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836742.597677:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836742.597737:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836742.597779:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836742.597800:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955776 00000100:00100000:3.0:1788836742.597806:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955776 00000100:00100000:3.0:1788836742.597853:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788836742.597874:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782955776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836742.597887:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836742.597899:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf77f47400/0xf7b38383a65554e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a65554e1 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597922:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf77f47400/0xf7b38383a65554e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a65554e1 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597931:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf77f47400/0xf7b38383a65554e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65554e1 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.597939:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf77f47400, rc 0) 00000100:00100000:3.0:1788836742.597975:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782955776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836742.597981:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788836742.598043:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836742.598055:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554e8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.598070:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a65554e8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836742.598110:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836742.598137:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836742.598152:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade428cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836742.598166:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782955904 00000100:00100000:3.0:1788836742.598169:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782955904 00000100:00100000:3.0:1788836742.598190:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788836742.598196:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782955904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788836742.598209:0:17175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836742.598224:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836742.598227:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788836742.598319:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782955904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836742.598326:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788836742.598355:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782955904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788836742.598393:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836742.598398:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554e8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.598406:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf77f46e00/0xf7b38383a65554e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a65554e8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836742.915436:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836742.922070:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782956032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836742.922460:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836742.922526:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956032 00000100:00100000:2.0:1788836742.922535:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956032 00000100:00100000:2.0:1788836742.922590:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836742.922601:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782956032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836742.922631:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836742.922674:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782956032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836742.922680:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788836742.922702:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836742.922736:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782956032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836743.422243:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836743.422276:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782956160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836743.422343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836743.422439:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956160 00000100:00100000:0.0:1788836743.422447:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956160 00000100:00100000:0.0:1788836743.422494:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836743.422503:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782956160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836743.422538:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836743.422594:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782956160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836743.422601:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836743.422671:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782956160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836743.934253:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782956288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836743.934330:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836743.934456:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956288 00000100:00100000:3.0:1788836743.934477:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956288 00000100:00100000:0.0:1788836743.934484:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782956416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836743.934518:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836743.934536:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836743.934544:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782956288:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836743.934556:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956416 00000100:00100000:0.0:1788836743.934559:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956416 00000004:00000024:3.0:1788836743.934578:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836743.934595:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836743.934601:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782956416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836743.934614:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836743.934829:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782956416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836743.934863:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788836743.934894:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836743.935550:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782956416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836743.940904:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782956288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6347us (6560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836743.940921:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788836743.941101:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836743.941218:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782956288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836744.958246:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836745.406663:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788836745.982313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836745.982322:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836745.982326:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836745.982342:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adf50b5f800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836745.982369:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade439f1500 x1875730782956928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836745.982412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836745.982415:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836745.982417:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836745.982422:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8adf772a9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788836745.982434:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ade439f0a80 x1875730782957440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836745.982545:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782957056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982632:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.982679:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782957696:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982704:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.982748:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788836745.982754:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782956544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982790:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.982833:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782957184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982860:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.982892:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782957824:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982915:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.982958:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782956672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.982986:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983328:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782957312:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.983362:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983383:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782957952:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.983416:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983436:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788836745.983442:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782956800:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.983465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983484:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782957568:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.983505:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983517:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782958080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.983536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983561:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782956928:0@lo:8:kworker.0 00000100:00100000:3.0:1788836745.983586:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.983605:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782957440:0@lo:8:kworker.0 00000100:00100000:3.0:1788836745.983627:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836745.983666:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836745.983683:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957056 00000100:00100000:3.0:1788836745.983692:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957056 00000100:00100000:3.0:1788836745.983740:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957696 00000100:00100000:3.0:1788836745.983743:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957696 00000100:00100000:3.0:1788836745.983771:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957824 00000100:00100000:3.0:1788836745.983774:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957824 00000100:00100000:3.0:1788836745.983788:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957952 00000100:00100000:3.0:1788836745.983790:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957952 00000100:00100000:3.0:1788836745.983817:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957568 00000100:00100000:3.0:1788836745.983821:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957568 00000100:00100000:3.0:1788836745.983834:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958080 00000100:00100000:3.0:1788836745.983837:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958080 00000100:00100000:3.0:1788836745.983855:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836745.983863:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782957056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.984517:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957312 00000100:00100000:1.0:1788836745.984524:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957312 00000100:00100000:1.0:1788836745.984556:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956800 00000100:00100000:1.0:1788836745.984559:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956800 00000100:00100000:1.0:1788836745.984572:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956928 00000100:00100000:1.0:1788836745.984575:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956928 00000100:00100000:1.0:1788836745.984585:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957440 00000100:00100000:1.0:1788836745.984588:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957440 00000100:00100000:1.0:1788836745.984598:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836745.984606:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782957312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.984689:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782957312:12345-0@lo:400:kworker.0 Request processed in 83us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.984697:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836745.984716:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836745.984722:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782956800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.984757:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782956800:12345-0@lo:400:kworker.0 Request processed in 30us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.984763:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836745.984775:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836745.984779:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782956928:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788836745.984823:0:18689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1788836745.984861:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7b38383a65554ef 00000100:00100000:3.0:1788836745.986235:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782957056:12345-0@lo:400:kworker.0 Request processed in 2367us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.986245:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00002000:00100000:1.0:1788836745.986909:0:18689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adf7fbc2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788836745.986935:0:18689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788836745.986948:0:18689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788836745.987444:0:18689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788836745.987490:0:18689:0:(import.c:65:import_set_state_nolock()) ffff8adf7fbc4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836745.987596:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875730782956928:12345-0@lo:8:kworker.0 Request processed in 2813us (4007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.987606:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836745.987642:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836745.987650:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875730782957440:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788836745.987684:0:18689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1788836745.987718:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7b38383a65554f6 00002000:00100000:1.0:1788836745.987729:0:18689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8adf7fbc0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788836745.987733:0:18689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788836745.987736:0:18689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788836745.987766:0:18689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788836745.987780:0:18689:0:(import.c:65:import_set_state_nolock()) ffff8adf7fbc7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836745.987822:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875730782957440:12345-0@lo:8:kworker.0 Request processed in 172us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.987830:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836745.988103:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836745.988119:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782957696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.988163:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782957696:12345-0@lo:400:kworker.0 Request processed in 51us (5458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.988170:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836745.988186:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836745.988193:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782957824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.988225:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782957824:12345-0@lo:400:kworker.0 Request processed in 33us (5309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.988232:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836745.988244:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836745.988408:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782957952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.988467:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782957952:12345-0@lo:400:kworker.0 Request processed in 202us (5050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.988474:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836745.988490:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836745.988498:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.988529:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782957568:12345-0@lo:400:kworker.0 Request processed in 33us (5023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.988535:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836745.988547:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836745.988554:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782958080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.988581:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782958080:12345-0@lo:400:kworker.0 Request processed in 29us (5045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.988587:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788836745.988630:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836745.988637:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836745.988639:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836745.988728:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77369c00 x1875730782957824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836745.988748:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782957824:0@lo:400:kworker.0 00010000:00080000:3.0:1788836745.988768:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f2d80 x1875730782957056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836745.988778:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782957056:0@lo:400:kworker.0 00010000:00080000:3.0:1788836745.988790:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f1c00 x1875730782957696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836745.988823:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782957696:0@lo:400:kworker.0 00010000:00080000:0.0:1788836745.989190:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f1500 x1875730782956928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836745.989219:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788836745.989231:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836745.989238:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788836745.989240:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf50b5f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836745.989279:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836745.989286:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875730782956928:0@lo:8:kworker.0 00010000:00080000:0.0:1788836745.989304:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f0a80 x1875730782957440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836745.989313:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788836745.989319:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836745.989322:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788836745.989324:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8adf772a9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836745.989337:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836745.989341:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875730782957440:0@lo:8:kworker.0 00000004:00080000:0.0:1788836745.989406:0:17925:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788836745.989432:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958336:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788836745.989487:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836745.989515:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad780 going to sleep for 11 seconds 00000004:00080000:0.0:1788836745.989534:0:17924:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836745.989647:0:17924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 529895634349ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788836745.989655:0:17924:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788836745.990185:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782957184 00000100:00100000:1.0:1788836745.990196:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782957184 00000100:00100000:1.0:1788836745.990253:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956672 00000100:00100000:1.0:1788836745.990257:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956672 00000100:00100000:1.0:1788836745.990340:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836745.990350:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.990427:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782957184:12345-0@lo:400:kworker.0 Request processed in 78us (7565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.990447:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836745.990465:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836745.990471:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782956672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.990503:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782956672:12345-0@lo:400:kworker.0 Request processed in 33us (7517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.990509:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836745.990543:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782956544 00000100:00100000:1.0:1788836745.990547:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782956544 00000100:00100000:1.0:1788836745.990574:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788836745.990581:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782956544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.990614:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782956544:12345-0@lo:400:kworker.0 Request processed in 34us (7823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836745.990621:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:1.0:1788836745.990655:0:17207:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788836745.990731:0:17207:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529896718352ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788836745.990738:0:17207:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788836745.990906:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836745.990923:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782958208:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788836745.992117:0:17208:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788836745.992147:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17208:1875730782958592:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788836745.992221:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.992260:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836745.992305:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958336 00000100:00100000:3.0:1788836745.992312:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958336 00000100:00100000:3.0:1788836745.992361:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958592 00000100:00100000:3.0:1788836745.992364:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958592 00000100:00100000:3.0:1788836745.992390:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836745.992398:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17925:x1875730782958336:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788836745.992682:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836745.992691:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17208:x1875730782958592:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788836745.992737:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836745.992774:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782956544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.992794:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782957184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836745.992825:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836745.992832:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782958464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836745.992867:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836745.992899:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958464 00000100:00100000:3.0:1788836745.992903:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958464 00000100:00100000:3.0:1788836745.992931:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836745.992949:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782958464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836745.992970:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788836745.993048:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875730782958464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836745.993056:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788836745.993093:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade445c7480 x1875730782958464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836745.993109:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782958464:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788836745.995397:0:17914:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788836745.995621:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782956800:0@lo:400:kworker.0 00010000:00080000:0.0:1788836745.995644:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f0000 x1875730782957568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836745.995655:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782957568:0@lo:400:kworker.0 00010000:00080000:0.0:1788836745.995674:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77369f80 x1875730782958080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836745.995682:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782958080:0@lo:400:kworker.0 00000100:00100000:0.0:1788836745.995696:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782956672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836745.995710:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782957312:0@lo:400:kworker.0 00010000:00080000:0.0:1788836745.995722:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf77369500 x1875730782957952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836745.995730:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf77369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782957952:0@lo:400:kworker.0 00000100:00100000:1.0:1788836745.995926:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836745.996138:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958208 00000100:00100000:0.0:1788836745.996146:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958208 00000100:00100000:0.0:1788836745.996197:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836745.996206:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1875730782958208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836745.996252:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788836745.996413:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1875730782958208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836745.996421:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788836745.996456:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44551180 x1875730782958208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836745.996473:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782958208:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1788836746.004442:0:19115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788836746.004454:0:19115:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788836746.004569:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17925:x1875730782958336:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12165us (15075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836746.004582:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788836746.004658:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44552300 x1875730782958336/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836761 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836746.004675:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958336:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788836746.004692:0:17925:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788836746.004741:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958720:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788836746.004783:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836746.004826:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf496ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836746.004848:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958720 00000100:00100000:0.0:1788836746.004855:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958720 00000100:00100000:0.0:1788836746.006869:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836746.006895:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17925:x1875730782958720:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788836746.006955:0:18690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788836746.007634:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17925:x1875730782958720:12345-0@lo:5:osp-pre-1-1.0 Request processed in 749us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836746.007642:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788836746.011463:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade44552300 x1875730782958720/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836762 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836746.011487:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958720:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788836746.011509:0:17925:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788836746.011584:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958848:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788836746.011662:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836746.011714:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958848 00000100:00100000:0.0:1788836746.011725:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958848 00000100:00100000:0.0:1788836746.011789:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836746.011811:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17925:x1875730782958848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788836746.011867:0:19115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1788836746.012178:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade41082c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788836746.013171:0:17161:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788836746.018791:0:18692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788836746.018824:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788836746.018831:0:18692:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788836746.031891:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.031908:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.031931:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.033090:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.033110:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033137:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033151:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033159:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033185:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.033202:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.033209:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033218:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.033223:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033242:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033264:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033273:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a65554fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033296:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.033298:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.033300:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.033892:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.033900:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033912:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.033916:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.033920:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.033931:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034301:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034317:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034333:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.034344:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.034348:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034356:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.034360:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034368:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034382:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034389:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555504 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.034405:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.034407:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.034409:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.035413:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.035430:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035444:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.035448:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.035454:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035465:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035475:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035482:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035500:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.035512:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.035518:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035526:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.035530:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035539:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035560:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035568:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655550b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.035584:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.035586:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.035587:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.038715:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.038734:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039106:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.039112:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.039120:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039137:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039150:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039158:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039190:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.039202:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.039209:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.039218:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.040845:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.040869:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.040894:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.040903:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d03ae1ea/0xf7b38383a6555512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.040930:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.040932:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.040935:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.041675:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.041685:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041700:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.041713:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.041721:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041734:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041743:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041753:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041774:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.041785:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.041791:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041811:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.041815:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041823:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041836:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041854:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a389fc2/0xf7b38383a6555519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.041870:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.041872:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.041874:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.043390:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.043400:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043416:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.043420:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.043426:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043438:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043449:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043457:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043478:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.043492:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.043504:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043512:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.043517:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043526:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043542:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043550:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b12df4/0xf7b38383a6555520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.043567:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.043569:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.043571:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836746.062718:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788836746.062736:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.062761:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788836746.062767:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836746.062782:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.062813:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.062825:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.062834:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.062863:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.063691:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.063705:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.063716:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.063723:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.063749:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.063771:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.063779:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dad86fd/0xf7b38383a6555527 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.063821:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.063823:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.063825:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.065166:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.065180:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065198:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.065204:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.065211:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065327:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065340:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065356:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065375:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836746.065388:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836746.065394:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065403:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992c00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836746.065408:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065418:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065435:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065443:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa2b888a/0xf7b38383a655552e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.065460:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.065462:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836746.065464:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.066185:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.066204:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.066216:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.066221:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.066497:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.066510:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.066521:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.066529:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.066599:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836746.066888:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836746.066896:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.066906:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836746.066912:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.066922:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067094:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067116:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beccbf4e/0xf7b38383a6555535 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067142:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.067144:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.067146:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836746.067446:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836746.067454:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.067466:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788836746.067471:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836746.067476:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.067488:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.067506:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.067514:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836746.067538:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836746.067706:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836746.067713:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067722:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43992200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836746.067726:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067735:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067748:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067755:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa0497c/0xf7b38383a655553c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.067771:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.067773:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.067775:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788836746.071662:0:19504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788836746.071706:0:19504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788836746.071712:0:19504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788836746.072246:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17925:x1875730782958848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60439us (60575us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788836746.072260:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836746.072384:0:17925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788836746.072395:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17925:1875730782958848:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788836746.072416:0:17925:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788836746.072486:0:17925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1875730782958976:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788836746.072534:0:17925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836746.072572:0:17925:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836746.073086:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782958976 00000100:00100000:2.0:1788836746.073096:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782958976 00000100:00100000:2.0:1788836746.073150:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836746.073162:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1875730782958976:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788836746.073232:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17925:x1875730782958976:12345-0@lo:900:osp-pre-1-1.0 Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836746.073240:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788836746.073834:0:17925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade445c7480 x1875730782958976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836762 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836746.073849:0:17925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17925:1875730782958976:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788836746.074340:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.074351:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.074370:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788836746.074375:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.074384:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.074409:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.074423:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.074431:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.074457:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836746.074527:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836746.074536:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.074545:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836746.074550:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.074559:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.074579:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.074586:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a6555543 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.074607:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.074608:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.074610:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.078179:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.078199:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.078223:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788836746.078228:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.078237:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.078254:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.078403:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.078424:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.078445:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836746.078455:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836746.078464:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.078472:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:1.0:1788836746.078478:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.078498:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.078521:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.078529:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a655554a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836746.078553:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.078555:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836746.078557:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.079352:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.079363:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.079377:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788836746.079381:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.079387:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.079398:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.079408:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.079416:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.079438:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.079550:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.079562:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.079573:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.079578:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.079587:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.079607:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.079619:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555551 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.079646:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.079648:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.079650:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.081437:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.081454:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.081488:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788836746.081494:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.081502:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.081518:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.081530:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.081538:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.081662:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836746.084213:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.084230:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.084252:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788836746.084258:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.084404:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.084424:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.084459:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.084478:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.092518:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836746.092540:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.092558:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.092564:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.092577:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.092604:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.092613:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555558 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.093066:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.093073:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.093081:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.093103:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.093113:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.093124:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.093132:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.093134:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.093137:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836746.098525:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836746.098550:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a30a155/0xf7b38383a655555f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.098566:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.099337:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.099347:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099364:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.099370:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.099379:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099398:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099408:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099431:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099457:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.099977:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788836746.099982:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836746.099986:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.099988:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.099997:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836746.099998:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.100002:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836746.100003:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100034:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100044:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100051:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100052:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100060:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100084:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.100318:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100330:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab78346f/0xf7b38383a6555566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100361:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.100366:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100374:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.100377:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100385:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836746.100386:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.100391:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100396:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100404:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000042e568c/0xf7b38383a655556d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100406:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.100410:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.100414:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100418:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100420:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100422:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836746.100424:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100427:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100429:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100430:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836746.100432:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100440:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100460:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.100537:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.100542:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100562:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.100566:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100574:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100585:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100592:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd30b44/0xf7b38383a6555574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.100605:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100607:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.100608:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.100887:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.100893:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100902:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.100906:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.100910:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100919:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100950:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100958:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.100978:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.101037:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.101042:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101050:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.101052:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101062:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101264:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101274:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8bf3b49/0xf7b38383a655557b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101288:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.101290:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.101292:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.101310:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.101316:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101324:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.101327:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.101331:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101339:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101347:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101354:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101386:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.101836:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.101843:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101852:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.101856:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101872:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101884:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101892:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b55a50/0xf7b38383a6555582 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.101917:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.101919:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.101921:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.101924:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.101929:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101947:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.101950:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.101955:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101965:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101973:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.101982:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102001:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.102256:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.102262:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102270:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46a00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.102274:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102282:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102294:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102300:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b824afad/0xf7b38383a6555589 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102314:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.102316:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.102318:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.102391:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.102397:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102406:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.102416:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.102421:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102432:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102440:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102448:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.102477:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.102887:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.102894:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102914:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.102917:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102925:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102936:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102943:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a696508a/0xf7b38383a6555590 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.102966:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.102968:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.102970:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.103089:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.103095:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103104:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.103108:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.103112:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103121:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103129:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103144:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103161:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.103203:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.103208:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.103216:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47e00 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.103219:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.103239:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.103256:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.103264:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278a4e22/0xf7b38383a6555597 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.103278:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.103280:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.103281:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.103496:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.103501:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103519:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.103522:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.103526:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103536:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103543:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103551:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.103571:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.104052:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.104058:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104067:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.104071:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104153:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836746.104162:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836746.104166:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104167:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104173:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1423cbe/0xf7b38383a655559e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104182:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.104186:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.104191:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104199:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836746.104200:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104201:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.104203:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836746.104208:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104217:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104235:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.104291:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.104296:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104304:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f47000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.104307:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104316:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104327:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104334:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531058cf/0xf7b38383a65555a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104346:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.104348:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.104349:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.104605:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.104611:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104619:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.104622:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.104626:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104635:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104666:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104674:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.104692:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836746.104750:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.104755:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104774:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf77f46200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.104777:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104785:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104807:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104814:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf7691c/0xf7b38383a65555ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.104829:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.104830:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.104832:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836746.105108:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836746.105114:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.105124:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788836746.105127:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836746.105131:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.105140:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.105148:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.105157:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836746.105188:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788836746.105220:0:18692:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:2.0:1788836746.105245:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836746.105251:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.105258:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f80600 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:2.0:1788836746.105261:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.105270:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.105286:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.105293:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08c4408/0xf7b38383a65555b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836746.105306:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.105308:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836746.105310:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836746.105366:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17208:x1875730782958592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112670us (113138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836746.105378:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836746.105420:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17208:1875730782958592:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788836746.105440:0:17208:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788836746.105498:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17208:1875730782959104:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788836746.105541:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836746.105579:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf48b37840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836746.105716:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959104 00000100:00100000:3.0:1788836746.105723:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959104 00000100:00100000:3.0:1788836746.105781:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836746.105791:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17208:x1875730782959104:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788836746.105843:0:18689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788836746.122470:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17208:x1875730782959104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16670us (16917us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788836746.122486:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836746.122691:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17208:1875730782959104:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788836746.122714:0:17208:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788836747.006139:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836747.733191:0:19860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788836748.031650:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836748.045062:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782959232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836748.045134:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836748.045185:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959232 00000100:00100000:0.0:1788836748.045193:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959232 00000100:00100000:0.0:1788836748.045246:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836748.045256:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782959232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836748.045285:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836748.045329:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782959232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836748.045336:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836748.045383:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782959232:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788836748.049879:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836748.545628:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782959360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836748.545701:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836748.545772:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959360 00000100:00100000:2.0:1788836748.545781:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959360 00000100:00100000:2.0:1788836748.545827:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836748.545837:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782959360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836748.545873:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788836748.545921:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782959360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836748.545936:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836748.545986:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782959360:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788836748.579502:0:19912:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836748.579717:0:19912:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788836749.054456:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836749.054483:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782959488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836749.054557:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836749.054667:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959488 00000100:00100000:0.0:1788836749.054676:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959488 00000100:00100000:0.0:1788836749.054731:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836749.054781:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782959488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836749.054834:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836749.054886:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782959488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.054893:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836749.055064:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782959488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836749.055276:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782959616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836749.055303:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836749.055365:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959616 00000100:00100000:0.0:1788836749.055369:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959616 00000100:00100000:0.0:1788836749.055415:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836749.055422:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782959616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836749.055436:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836749.055469:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782959616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.055475:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836749.055500:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782959616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788836749.056032:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836749.056379:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1788836749.597776:0:19962:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836749.597985:0:19962:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788836749.756138:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.756181:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285440 00000100:00100000:2.0:1788836749.756191:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285440 00000100:00100000:2.0:1788836749.757962:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:2.0:1788836749.757976:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1875730770285440:12345-192.168.201.38@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788836749.758007:0:17174:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 02a66b92-676f-4a0a-93db-5a4922690379@192.168.201.38@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1788836749.758049:0:17174:0:(genops.c:1385:class_connect()) connect: client 02a66b92-676f-4a0a-93db-5a4922690379, cookie 0xf7b38383a65555ba 00000100:00080000:2.0:1788836749.758168:0:17174:0:(import.c:65:import_set_state_nolock()) ffff8ade4393d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836749.758234:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+5:2393:x1875730770285440:12345-192.168.201.38@tcp:250:mount.lustre.0 Request processed in 260us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.758240:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000040:00080000:2.0:1788836749.764459:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788836749.765333:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.765369:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285568 00000100:00100000:0.0:1788836749.765380:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285568 00000100:00100000:0.0:1788836749.765431:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:0.0:1788836749.765442:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+5:14918:x1875730770285568:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788836749.765460:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836749.765477:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992800/0xf7b38383a65555c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa672 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.765505:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992800/0xf7b38383a65555c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa672 expref: 6 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.765528:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992800/0xf7b38383a65555c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa672 expref: 6 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.765537:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992800, rc 0) 00000100:00100000:0.0:1788836749.765587:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+6:14918:x1875730770285568:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 147us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.765595:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:2.0:1788836749.773151:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.773200:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285696 00000100:00100000:2.0:1788836749.773210:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285696 00000100:00100000:2.0:1788836749.773258:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:2.0:1788836749.773267:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+6:14918:x1875730770285696:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836749.773379:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+6:14918:x1875730770285696:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 113us (238us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836749.773387:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:0.0:1788836749.786767:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.786810:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285824 00000100:00100000:0.0:1788836749.786819:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285824 00000100:00100000:0.0:1788836749.786876:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1788836749.786886:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+6:14918:x1875730770285824:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788836749.786903:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836749.786918:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993c00/0xf7b38383a65555c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa679 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.786946:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993c00/0xf7b38383a65555c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa679 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.786957:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993c00/0xf7b38383a65555c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa679 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.786966:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993c00, rc 0) 00000100:00100000:0.0:1788836749.787027:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+7:14918:x1875730770285824:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.787034:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:2.0:1788836749.795376:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.795419:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770285952 00000100:00100000:2.0:1788836749.795428:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770285952 00000100:00100000:2.0:1788836749.795474:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:2.0:1788836749.795482:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+7:14918:x1875730770285952:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836749.795624:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+8:14918:x1875730770285952:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.795631:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:0.0:1788836749.803484:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836749.803558:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286080 00000100:00100000:1.0:1788836749.803568:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286080 00000100:00100000:1.0:1788836749.803653:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:1.0:1788836749.803664:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+8:14918:x1875730770286080:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788836749.803817:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+8:14918:x1875730770286080:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 154us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836749.803826:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:2.0:1788836749.815558:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.815979:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286208 00000100:00100000:0.0:1788836749.815989:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286208 00000100:00100000:0.0:1788836749.816399:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:0.0:1788836749.816412:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286208:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836749.816582:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286208:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 173us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.816591:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:1.0:1788836749.843068:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.843329:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286336 00000100:00100000:2.0:1788836749.843339:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286336 00000100:00100000:2.0:1788836749.843386:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:2.0:1788836749.843395:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286336:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836749.843599:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286336:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 204us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.843607:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:1.0:1788836749.849524:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.849785:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286464 00000100:00100000:0.0:1788836749.849795:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286464 00000100:00100000:0.0:1788836749.849889:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:0.0:1788836749.849899:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286464:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836749.850072:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+8:14937:x1875730770286464:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 173us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.850089:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:3.0:1788836749.867410:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.867679:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286592 00000100:00100000:0.0:1788836749.867689:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286592 00000100:00100000:0.0:1788836749.867769:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1788836749.867781:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+8:14918:x1875730770286592:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788836749.867798:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836749.867817:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992c00/0xf7b38383a65555cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa6aa expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.867843:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992c00/0xf7b38383a65555cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6aa expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.867853:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992c00/0xf7b38383a65555cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6aa expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.867876:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992c00, rc 0) 00000100:00100000:0.0:1788836749.868109:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+9:14918:x1875730770286592:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 329us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.868116:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:1.0:1788836749.876508:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.876582:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286720 00000100:00100000:0.0:1788836749.876591:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286720 00000100:00100000:0.0:1788836749.876642:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:0.0:1788836749.876653:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+9:14918:x1875730770286720:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788836749.876679:0:17174:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788836749.876700:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788836749.876702:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788836749.876704:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788836749.876707:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788836749.876708:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788836749.887211:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+9:14918:x1875730770286720:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 10549us (10699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.887228:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:3.0:1788836749.893785:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.893996:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286848 00000100:00100000:0.0:1788836749.894007:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286848 00000100:00100000:0.0:1788836749.894292:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:0.0:1788836749.894305:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fc51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+9:14918:x1875730770286848:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788836749.894326:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836749.894345:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa6b1 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.894376:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.894406:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836749.894416:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992200, rc 0) 00000100:00100000:0.0:1788836749.894493:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fc51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+10:14918:x1875730770286848:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 191us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.894499:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1788836749.898843:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.900877:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770286976 00000100:00100000:2.0:1788836749.900891:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770286976 00000100:00100000:2.0:1788836749.900947:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:2.0:1788836749.900957:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14918:x1875730770286976:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836749.901261:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14918:x1875730770286976:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 303us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.901269:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:1.0:1788836749.905923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.906034:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287104 00000100:00100000:2.0:1788836749.906095:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287104 00000100:00100000:2.0:1788836749.906225:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1788836749.906237:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14918:x1875730770287104:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836749.906400:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14918:x1875730770287104:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 164us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.906408:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:1.0:1788836749.909166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.909350:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287232 00000100:00100000:2.0:1788836749.909360:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287232 00000100:00100000:2.0:1788836749.909407:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:2.0:1788836749.909417:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14944:x1875730770287232:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836749.909571:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:14944:x1875730770287232:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 153us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.909580:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:1.0:1788836749.919218:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836749.919370:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287360 00000100:00100000:3.0:1788836749.919381:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287360 00000100:00100000:3.0:1788836749.919436:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:3.0:1788836749.919446:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+10:14944:x1875730770287360:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836749.919594:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+10:14944:x1875730770287360:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836749.919602:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:1.0:1788836749.923814:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836749.923856:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836749.924082:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287488 00000100:00100000:3.0:1788836749.924108:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287488 00000100:00100000:3.0:1788836749.924148:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287744 00000100:00100000:3.0:1788836749.924160:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287744 00000100:00100000:3.0:1788836749.924189:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836749.924198:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875730770287488:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788836749.924227:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5dda4d66-c699-4d7b-9c87-3e7b02502788@192.168.201.38@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788836749.924276:0:17182:0:(genops.c:1385:class_connect()) connect: client 5dda4d66-c699-4d7b-9c87-3e7b02502788, cookie 0xf7b38383a65555dd 00000004:00100000:3.0:1788836749.924299:0:17182:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788836749.924499:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8adf444f1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836749.924564:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2393:x1875730770287488:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 367us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836749.924572:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836749.924588:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1788836749.924592:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875730770287744:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788836749.924607:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5dda4d66-c699-4d7b-9c87-3e7b02502788@192.168.201.38@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788836749.924633:0:17182:0:(genops.c:1385:class_connect()) connect: client 5dda4d66-c699-4d7b-9c87-3e7b02502788, cookie 0xf7b38383a65555e4 00000004:00100000:3.0:1788836749.924644:0:17182:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788836749.924781:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8ade43969000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836749.924808:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2393:x1875730770287744:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 215us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836749.924815:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788836749.935320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.935374:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.936122:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287872 00000100:00100000:2.0:1788836749.936133:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287872 00000100:00100000:2.0:1788836749.936207:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770287616 00000100:00100000:2.0:1788836749.936210:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770287616 00000100:00100000:2.0:1788836749.936237:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1788836749.936247:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:0:x1875730770287872:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836749.936286:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836749.936369:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:0:x1875730770287872:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 123us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.936374:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1788836749.936379:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1788836749.936383:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:0:x1875730770287616:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788836749.936399:0:18652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788836749.936436:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:0:x1875730770287616:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 55us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.936441:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00080000:1.0:1788836749.937319:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836749.937323:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836749.943821:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.943981:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288000 00000100:00100000:2.0:1788836749.943993:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288000 00000100:00100000:2.0:1788836749.944091:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788836749.944101:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288000:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836749.944135:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788836749.944243:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288000:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 143us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.944251:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788836749.946454:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.946780:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288128 00000100:00100000:0.0:1788836749.946791:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288128 00000100:00100000:0.0:1788836749.946849:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788836749.946858:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288128:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788836749.946930:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288128:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 73us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.946937:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788836749.949844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.949930:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.950061:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836749.950181:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288512 00000100:00100000:2.0:1788836749.950191:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288512 00000100:00100000:2.0:1788836749.950249:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1788836749.950259:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288512:12345-192.168.201.38@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788836749.950334:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288512:12345-192.168.201.38@tcp:900:mount.lustre.0 Request processed in 77us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836749.950343:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1788836749.952456:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288256 00000100:00100000:3.0:1788836749.952470:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288256 00000100:00100000:3.0:1788836749.952517:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288384 00000100:00100000:3.0:1788836749.952521:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288384 00000100:00100000:3.0:1788836749.952545:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1788836749.952570:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875730770288256:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788836749.952610:0:19115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5dda4d66-c699-4d7b-9c87-3e7b02502788@192.168.201.38@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788836749.952656:0:19115:0:(genops.c:1385:class_connect()) connect: client 5dda4d66-c699-4d7b-9c87-3e7b02502788, cookie 0xf7b38383a65555eb 00002000:00100000:3.0:1788836749.952670:0:19115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5dda4d66-c699-4d7b-9c87-3e7b02502788/ffff8ade4396f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836749.952688:0:19115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788836749.952868:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788836749.952876:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875730770288384:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788836749.952897:0:18690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5dda4d66-c699-4d7b-9c87-3e7b02502788@192.168.201.38@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788836749.952922:0:18690:0:(genops.c:1385:class_connect()) connect: client 5dda4d66-c699-4d7b-9c87-3e7b02502788, cookie 0xf7b38383a65555f2 00002000:00100000:0.0:1788836749.952928:0:18690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5dda4d66-c699-4d7b-9c87-3e7b02502788/ffff8ade43780800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836749.952938:0:18690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836749.952940:0:19115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836749.952974:0:19115:0:(import.c:65:import_set_state_nolock()) ffff8adf770e0000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1788836749.953077:0:18690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836749.953112:0:18690:0:(import.c:65:import_set_state_nolock()) ffff8ade43787800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836749.953171:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2393:x1875730770288256:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 602us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836749.953179:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836749.955982:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836749.956356:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2393:x1875730770288384:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 3474us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836749.956369:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836749.957352:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288640 00000100:00100000:3.0:1788836749.957365:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288640 00000100:00100000:3.0:1788836749.957433:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1788836749.957443:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288640:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788836749.958384:0:17184:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 856us 00000004:00200000:3.0:1788836749.979432:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788836749.979563:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14918:x1875730770288640:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 22116us (23584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836749.979573:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00010000:00010000:1.0:1788836750.078362:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836750.112123:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836750.112327:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288768 00000100:00100000:0.0:1788836750.112338:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288768 00000100:00100000:0.0:1788836750.112397:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788836750.112409:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:14967:x1875730770288768:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:0.0:1788836750.112431:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836750.112458:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a65555f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa6e2 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112526:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112541:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112555:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836750.112637:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836750.112641:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836750.112678:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112704:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993e00/0xf7b38383a65555f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6e2 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112724:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6e2 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836750.112744:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:0.0:1788836750.112747:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836750.112751:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993600, rc 0) 00000100:00100000:0.0:1788836750.112812:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:14967:x1875730770288768:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 406us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836750.112820:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788836751.102992:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836751.103034:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782959872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836751.103105:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836751.103122:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836751.103153:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959872 00000100:00100000:0.0:1788836751.103160:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836751.103161:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959872 00000100:00100000:0.0:1788836751.103189:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836751.103211:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782959744 00000100:00100000:3.0:1788836751.103215:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782959744 00000100:00100000:3.0:1788836751.103239:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836751.103250:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782959872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836751.103304:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788836751.103307:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836751.103372:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782959872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836751.103379:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836751.103396:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836751.103403:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782959744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836751.103413:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788836751.103437:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782959744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836751.103443:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836751.103946:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782960256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.103978:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.103998:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782960768:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104044:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.104061:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782961280:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104084:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.104100:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836751.104106:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782960384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104124:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.104138:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782960896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104156:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.104180:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960256 00000100:00100000:2.0:1788836751.104191:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960256 00000100:00100000:2.0:1788836751.104225:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836751.104231:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782960256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104268:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782960256:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.104274:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836751.104291:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960768 00000100:00100000:2.0:1788836751.104294:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960768 00000100:00100000:2.0:1788836751.104310:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961280 00000100:00100000:2.0:1788836751.104312:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961280 00000100:00100000:2.0:1788836751.104322:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960384 00000100:00100000:2.0:1788836751.104324:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960384 00000100:00100000:2.0:1788836751.104333:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960896 00000100:00100000:2.0:1788836751.104336:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960896 00000100:00100000:2.0:1788836751.104348:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836751.104354:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782960768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104379:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875730782960768:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.104384:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836751.104393:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836751.104398:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782961280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104419:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875730782961280:12345-0@lo:400:kworker.0 Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.104424:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836751.104433:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836751.104437:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782960384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104458:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782960384:12345-0@lo:400:kworker.0 Request processed in 21us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.104472:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836751.104482:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836751.104487:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782960896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104526:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875730782960896:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.104531:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788836751.104549:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836751.104553:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836751.104555:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836751.104594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782960384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104614:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875730782960896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104622:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782960256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.104631:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875730782960768:0@lo:400:kworker.0 00010000:00080000:2.0:1788836751.104640:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca8380 x1875730782961280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836751.104649:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875730782961280:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104743:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782960000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104774:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836751.104805:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782960512:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104826:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836751.104841:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782961024:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104857:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836751.104870:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836751.104875:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782960128:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104893:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836751.104909:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782960640:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104934:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836751.104947:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782961152:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.104967:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836751.105854:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960512 00000100:00100000:2.0:1788836751.105862:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960512 00000100:00100000:2.0:1788836751.105909:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960128 00000100:00100000:2.0:1788836751.105912:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960128 00000100:00100000:2.0:1788836751.105925:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836751.105932:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782960512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.105989:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782960512:12345-0@lo:400:kworker.0 Request processed in 56us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.106007:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788836751.106050:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836751.106057:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782960128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.106085:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782960128:12345-0@lo:400:kworker.0 Request processed in 29us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.106091:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836751.106107:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961024 00000100:00100000:2.0:1788836751.106110:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961024 00000100:00100000:2.0:1788836751.106136:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961152 00000100:00100000:2.0:1788836751.106139:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961152 00000100:00100000:2.0:1788836751.106150:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836751.106156:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782961024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.106185:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875730782961024:12345-0@lo:400:kworker.0 Request processed in 30us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.106191:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836751.106202:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788836751.106207:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782961152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.106228:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875730782961152:12345-0@lo:400:kworker.0 Request processed in 21us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.106233:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788836751.106247:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836751.106250:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836751.106260:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960000 00000100:00100000:2.0:1788836751.106263:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960000 00000100:00100000:2.0:1788836751.106300:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788836751.106307:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782960000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836751.106344:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782960000:12345-0@lo:400:kworker.0 Request processed in 37us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.106350:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788836751.106654:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782959872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836751.106671:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade428d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782959744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836751.106955:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782960128:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.106968:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875730782961152:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.106977:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782960000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836751.106987:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782960512:0@lo:400:kworker.0 00010000:00080000:1.0:1788836751.106999:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d9500 x1875730782961024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836751.107031:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875730782961024:0@lo:400:kworker.0 00000100:00100000:3.0:1788836751.108259:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782960640 00000100:00100000:3.0:1788836751.108270:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782960640 00000100:00100000:3.0:1788836751.108353:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836751.108362:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782960640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836751.108453:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782960640:12345-0@lo:400:kworker.0 Request processed in 92us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836751.108460:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836751.108573:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782960640:0@lo:400:kworker.0 00000100:00080000:2.0:1788836751.111372:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836751.935497:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836751.935636:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770288896 00000100:00100000:2.0:1788836751.935646:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770288896 00000100:00100000:2.0:1788836751.935793:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1788836751.935805:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15019:x1875730770288896:12345-192.168.201.38@tcp:41:lfs.0 00000004:00000024:2.0:1788836751.935845:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788836751.935933:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15019:x1875730770288896:12345-192.168.201.38@tcp:41:lfs.0 Request processed in 130us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.935940:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00080000:0.0:1788836751.936157:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836751.938871:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836751.940251:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289024 00000100:00100000:0.0:1788836751.940265:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289024 00000100:00100000:0.0:1788836751.940397:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1788836751.940408:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289024:12345-192.168.201.38@tcp:41:lfs.0 00000004:00000024:0.0:1788836751.940448:0:17181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836751.941974:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289024:12345-192.168.201.38@tcp:41:lfs.0 Request processed in 1558us (3102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836751.941987:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00080000:2.0:1788836751.942334:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836751.946003:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836751.946132:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289152 00000100:00100000:1.0:1788836751.946142:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289152 00000100:00100000:1.0:1788836751.946205:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788836751.946215:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289152:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:1.0:1788836751.946245:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836751.946323:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289152:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836751.946330:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:2.0:1788836751.946637:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836751.948989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836751.949096:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289280 00000100:00100000:2.0:1788836751.949106:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289280 00000100:00100000:2.0:1788836751.949173:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788836751.949191:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289280:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:2.0:1788836751.949214:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788836751.949285:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15019:x1875730770289280:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836751.949292:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00080000:3.0:1788836751.949438:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836752.126725:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836752.130954:0:19504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5dda4d66-c699-4d7b-9c87-3e7b02502788 00000001:00080000:3.0:1788836752.130970:0:19504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788836752.227582:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.227984:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289408 00000100:00100000:2.0:1788836752.227995:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289408 00000100:00100000:2.0:1788836752.228076:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:2.0:1788836752.228086:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+10:15051:x1875730770289408:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836752.228109:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836752.228193:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615c800/0xf7b38383a6555607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa6e9 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.228224:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615c800/0xf7b38383a6555607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6e9 expref: 11 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.228237:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615c800/0xf7b38383a6555607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6e9 expref: 11 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.228246:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c800, rc 0) 00000100:00100000:2.0:1788836752.228468:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770289408:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 382us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.228476:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:2.0:1788836752.251563:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.251770:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289536 00000100:00100000:3.0:1788836752.251780:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289536 00000100:00100000:3.0:1788836752.251912:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:3.0:1788836752.251925:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770289536:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788836752.252123:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770289536:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 193us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.252149:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:1.0:1788836752.257338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.257481:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289664 00000100:00100000:2.0:1788836752.257492:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289664 00000100:00100000:2.0:1788836752.257559:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:2.0:1788836752.257570:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770289664:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836752.257724:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770289664:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 155us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.257733:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:1.0:1788836752.261783:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.263656:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289792 00000100:00100000:3.0:1788836752.263672:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289792 00000100:00100000:3.0:1788836752.263745:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:3.0:1788836752.263756:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770289792:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836752.263933:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770289792:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 178us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.263941:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:3.0:1788836752.302341:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.302539:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770289920 00000100:00100000:0.0:1788836752.302549:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770289920 00000100:00100000:0.0:1788836752.302618:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:0.0:1788836752.302630:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770289920:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836752.302792:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf81535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770289920:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 165us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836752.302799:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:1.0:1788836752.310198:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.310406:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290048 00000100:00100000:2.0:1788836752.310416:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290048 00000100:00100000:2.0:1788836752.310471:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:2.0:1788836752.310481:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770290048:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836752.310769:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:15058:x1875730770290048:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 288us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.310777:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:2.0:1788836752.316790:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.317399:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290176 00000100:00100000:3.0:1788836752.317409:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290176 00000100:00100000:3.0:1788836752.317469:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:3.0:1788836752.317480:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+11:15051:x1875730770290176:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836752.317496:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836752.317512:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade41f81600/0xf7b38383a655560e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa71a expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.317670:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade41f81600/0xf7b38383a655560e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa71a expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.317684:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade41f81600/0xf7b38383a655560e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa71a expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.317704:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81600, rc 0) 00000100:00100000:3.0:1788836752.317799:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+12:15051:x1875730770290176:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 320us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.317835:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:2.0:1788836752.326244:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.326570:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290304 00000100:00100000:1.0:1788836752.326645:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290304 00000100:00100000:1.0:1788836752.326710:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:1.0:1788836752.326720:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+12:15051:x1875730770290304:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788836752.326745:0:17176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788836752.326767:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788836752.326771:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788836752.326774:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788836752.326777:0:17176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788836752.326779:0:17176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788836752.331983:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+12:15051:x1875730770290304:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 5253us (5737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.331998:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:2.0:1788836752.337849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.337932:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290432 00000100:00100000:3.0:1788836752.337943:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290432 00000100:00100000:3.0:1788836752.338004:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:3.0:1788836752.338053:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+12:15051:x1875730770290432:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836752.338071:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836752.338088:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa721 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.338130:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.338145:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836752.338155:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81c00, rc 0) 00000100:00100000:2.0:1788836752.338259:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:15051:x1875730770290432:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 244us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.338267:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:0.0:1788836752.340936:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.341064:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290560 00000100:00100000:2.0:1788836752.341074:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290560 00000100:00100000:2.0:1788836752.341134:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:2.0:1788836752.341143:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:15051:x1875730770290560:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836752.341276:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:15051:x1875730770290560:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 132us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.341283:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:1.0:1788836752.346870:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.350305:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290688 00000100:00100000:0.0:1788836752.350321:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290688 00000100:00100000:0.0:1788836752.350389:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:0.0:1788836752.350400:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:15051:x1875730770290688:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788836752.350682:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:15051:x1875730770290688:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 282us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836752.350720:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:0.0:1788836752.360673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.362260:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290816 00000100:00100000:3.0:1788836752.362275:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290816 00000100:00100000:3.0:1788836752.362346:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:3.0:1788836752.362357:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:15060:x1875730770290816:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836752.362576:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:15060:x1875730770290816:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 220us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.362596:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:1.0:1788836752.387245:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.387347:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770290944 00000100:00100000:2.0:1788836752.387358:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770290944 00000100:00100000:2.0:1788836752.387433:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:2.0:1788836752.387443:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:15060:x1875730770290944:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836752.387595:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:15060:x1875730770290944:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 152us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.387612:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:1.0:1788836752.394729:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.394776:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.394804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.394838:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.394913:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291840 00000100:00100000:3.0:1788836752.394922:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291840 00000100:00100000:3.0:1788836752.394978:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291712 00000100:00100000:3.0:1788836752.394981:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291712 00000100:00100000:3.0:1788836752.395092:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788836752.395101:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2397:x1875730770291840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836752.395170:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2397:x1875730770291840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.395177:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788836752.395193:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1788836752.395200:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2397:x1875730770291712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836752.395226:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2397:x1875730770291712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.395232:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1788836752.395248:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292096 00000100:00100000:3.0:1788836752.395252:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292096 00000100:00100000:3.0:1788836752.395273:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291968 00000100:00100000:3.0:1788836752.395276:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291968 00000100:00100000:3.0:1788836752.395292:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836752.395298:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2397:x1875730770292096:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836752.395320:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2397:x1875730770292096:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.395326:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788836752.395337:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1788836752.395343:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2397:x1875730770291968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836752.395366:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2397:x1875730770291968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.395372:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788836752.396076:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.396116:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.396178:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291072 00000100:00100000:1.0:1788836752.396183:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291072 00000100:00100000:1.0:1788836752.396208:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291328 00000100:00100000:1.0:1788836752.396211:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291328 00000100:00100000:1.0:1788836752.396233:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788836752.396238:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875730770291072:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788836752.396261:0:17182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2@192.168.201.38@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788836752.396296:0:17182:0:(genops.c:1385:class_connect()) connect: client 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2, cookie 0xf7b38383a655561c 00000004:00100000:1.0:1788836752.396322:0:17182:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788836752.396905:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788836752.396912:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1875730770291328:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788836752.396931:0:18652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2@192.168.201.38@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788836752.396957:0:18652:0:(genops.c:1385:class_connect()) connect: client 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2, cookie 0xf7b38383a6555623 00000004:00100000:0.0:1788836752.396972:0:18652:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788836752.397049:0:18652:0:(import.c:65:import_set_state_nolock()) ffff8ade43786000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836752.397102:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2393:x1875730770291328:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 189us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836752.397109:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00080000:1.0:1788836752.397262:0:17182:0:(import.c:65:import_set_state_nolock()) ffff8adf7fbc5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836752.397585:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2393:x1875730770291072:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 1344us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836752.397592:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788836752.401146:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.401188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.401514:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.402107:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291456 00000100:00100000:3.0:1788836752.402141:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291456 00000100:00100000:3.0:1788836752.402205:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291200 00000100:00100000:3.0:1788836752.402209:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291200 00000100:00100000:3.0:1788836752.402224:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770291584 00000100:00100000:3.0:1788836752.402226:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770291584 00000100:00100000:3.0:1788836752.402242:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1788836752.402252:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:0:x1875730770291456:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836752.402289:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836752.402381:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:0:x1875730770291456:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 129us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.402388:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1788836752.402405:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836752.402410:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+7:0:x1875730770291200:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836752.402425:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788836752.402447:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+7:0:x1875730770291200:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 37us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.402453:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836752.402463:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1788836752.402468:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770291584:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836752.402477:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788836752.402492:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770291584:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 24us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.402497:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00080000:0.0:1788836752.402912:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836752.402916:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836752.409522:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836752.409813:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292224 00000100:00100000:3.0:1788836752.409825:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292224 00000100:00100000:3.0:1788836752.409888:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788836752.409913:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292224:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788836752.410043:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292224:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.410052:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788836752.421586:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.421633:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836752.421668:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.421773:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292608 00000100:00100000:2.0:1788836752.421784:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292608 00000100:00100000:2.0:1788836752.421846:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1788836752.421857:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292608:12345-192.168.201.38@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788836752.421935:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292352 00000100:00100000:3.0:1788836752.421941:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292352 00000100:00100000:3.0:1788836752.421968:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292480 00000100:00100000:3.0:1788836752.421971:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292480 00000100:00100000:2.0:1788836752.422000:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292608:12345-192.168.201.38@tcp:900:mount.lustre.0 Request processed in 144us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836752.422006:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788836752.422045:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788836752.422046:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875730770292352:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788836752.422078:0:19115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2@192.168.201.38@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788836752.422124:0:19115:0:(genops.c:1385:class_connect()) connect: client 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2, cookie 0xf7b38383a655562a 00002000:00100000:3.0:1788836752.422135:0:19115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2/ffff8adf805b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836752.422147:0:19115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788836752.422517:0:19115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788836752.422525:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788836752.422533:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875730770292480:12345-192.168.201.38@tcp:8:mount.lustre.0 00000100:00080000:2.0:1788836752.422549:0:19115:0:(import.c:65:import_set_state_nolock()) ffff8ade4252c000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788836752.422565:0:18692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2@192.168.201.38@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788836752.422592:0:18692:0:(genops.c:1385:class_connect()) connect: client 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2, cookie 0xf7b38383a6555631 00002000:00100000:1.0:1788836752.422598:0:18692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2/ffff8adf7fbc1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836752.422605:0:18692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788836752.422608:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2393:x1875730770292352:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 563us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.422618:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00002000:00080000:2.0:1788836752.422713:0:18692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836752.422729:0:18692:0:(import.c:65:import_set_state_nolock()) ffff8ade4252b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836752.422751:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2393:x1875730770292480:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 218us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.422757:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788836752.424779:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836752.424936:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292736 00000100:00100000:0.0:1788836752.424945:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292736 00000100:00100000:0.0:1788836752.425064:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1788836752.425074:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292736:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788836752.425168:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788836752.425247:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15051:x1875730770292736:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 174us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836752.425270:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788836752.570092:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836752.570251:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292864 00000100:00100000:2.0:1788836752.570262:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292864 00000100:00100000:2.0:1788836752.570323:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788836752.570333:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15083:x1875730770292864:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788836752.570353:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836752.570375:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6555638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa752 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570458:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570472:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570484:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836752.570533:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836752.570538:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836752.570559:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570649:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615c000/0xf7b38383a6555638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570671:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836752.570680:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:2.0:1788836752.570709:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836752.570714:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615ca00, rc 0) 00000100:00100000:2.0:1788836752.570773:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+7:15083:x1875730770292864:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 441us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836752.570780:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788836753.153966:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836753.153989:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782961408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836753.154152:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836753.154200:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961408 00000100:00100000:2.0:1788836753.154208:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961408 00000100:00100000:2.0:1788836753.154267:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836753.154278:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782961408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836753.154313:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836753.154356:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782961408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836753.154363:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836753.154405:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782961408:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788836753.154882:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788836753.160288:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836753.666064:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782961536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836753.666137:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836753.666198:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961536 00000100:00100000:3.0:1788836753.666205:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961536 00000100:00100000:3.0:1788836753.666253:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836753.666263:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782961536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836753.666319:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788836753.666363:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782961536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836753.666371:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836753.666423:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782961536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788836754.174196:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836754.174439:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836754.174464:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782961664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836754.174537:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836754.174749:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782961792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836754.174781:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836754.174838:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961792 00000100:00100000:3.0:1788836754.174849:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961792 00000100:00100000:2.0:1788836754.174877:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961664 00000100:00100000:2.0:1788836754.174883:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961664 00000100:00100000:3.0:1788836754.174915:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836754.174924:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836754.174929:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782961792:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836754.174937:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782961664:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1788836754.174953:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000004:00000024:2.0:1788836754.174968:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836754.175002:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782961792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836754.175027:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836754.175056:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782961664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836754.175065:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788836754.175206:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836754.175210:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782961664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836754.175236:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782961792:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788836754.897363:0:20060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788836755.199146:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836755.656604:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836756.222998:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782961920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223211:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223259:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782962432:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223286:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223307:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782962944:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223345:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782963456:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223375:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223565:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788836756.223573:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782962304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223597:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223614:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782962816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836756.223661:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782963328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.223686:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.223795:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782962176:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.223822:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.223990:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782962688:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224029:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.224047:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782963200:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224069:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.224082:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788836756.224087:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782962048:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224110:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.224128:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782962560:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224148:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.224163:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782963072:0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224182:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.224203:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962432 00000100:00100000:3.0:1788836756.224210:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962432 00000100:00100000:3.0:1788836756.224246:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962944 00000100:00100000:3.0:1788836756.224249:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962944 00000100:00100000:3.0:1788836756.224272:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963456 00000100:00100000:3.0:1788836756.224275:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963456 00000100:00100000:3.0:1788836756.224297:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963328 00000100:00100000:3.0:1788836756.224300:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963328 00000100:00100000:3.0:1788836756.224312:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963200 00000100:00100000:3.0:1788836756.224314:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963200 00000100:00100000:3.0:1788836756.224324:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963072 00000100:00100000:3.0:1788836756.224326:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963072 00000100:00100000:3.0:1788836756.224342:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836756.224349:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782962432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224527:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730782962432:12345-0@lo:400:kworker.0 Request processed in 177us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224534:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836756.224553:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836756.224560:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782962944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224587:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782962944:12345-0@lo:400:kworker.0 Request processed in 29us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224593:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836756.224603:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836756.224608:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782963456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224646:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782963456:12345-0@lo:400:kworker.0 Request processed in 38us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224652:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836756.224663:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836756.224668:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782963328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224693:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730782963328:12345-0@lo:400:kworker.0 Request processed in 25us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224708:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836756.224720:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836756.224725:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782963200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224767:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782963200:12345-0@lo:400:kworker.0 Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224773:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836756.224784:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836756.224790:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782963072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224814:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875730782963072:12345-0@lo:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224819:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1788836756.224834:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836756.224855:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962304 00000100:00100000:3.0:1788836756.224858:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962304 00000100:00100000:3.0:1788836756.224874:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962816 00000100:00100000:3.0:1788836756.224876:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962816 00000100:00100000:3.0:1788836756.224885:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962176 00000100:00100000:3.0:1788836756.224887:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962176 00000100:00100000:3.0:1788836756.224896:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962688 00000100:00100000:3.0:1788836756.224898:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962688 00000100:00100000:3.0:1788836756.224908:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836756.224914:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782962304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224940:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782962304:12345-0@lo:400:kworker.0 Request processed in 26us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224945:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836756.224954:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836756.224959:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782962816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.224988:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782962816:12345-0@lo:400:kworker.0 Request processed in 28us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.224993:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836756.225004:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836756.225028:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782962176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.225055:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782962176:12345-0@lo:400:kworker.0 Request processed in 46us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.225061:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836756.225070:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836756.225075:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836756.225096:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782962688:12345-0@lo:400:kworker.0 Request processed in 21us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.225100:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836756.226753:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782961920 00000100:00100000:2.0:1788836756.226769:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782961920 00000100:00100000:2.0:1788836756.226826:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788836756.226835:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3617:x1875730782961920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.226905:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3617:x1875730782961920:12345-0@lo:400:kworker.0 Request processed in 72us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836756.226913:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788836756.227130:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836756.227137:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836756.227140:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836756.227143:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836756.227156:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962048 00000100:00100000:2.0:1788836756.227160:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962048 00000100:00100000:2.0:1788836756.227193:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782962560 00000100:00100000:2.0:1788836756.227197:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782962560 00000100:00100000:2.0:1788836756.227210:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836756.227216:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782962048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227252:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782962048:12345-0@lo:400:kworker.0 Request processed in 36us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836756.227263:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836756.227272:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836756.227276:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782962560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227304:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782962560:12345-0@lo:400:kworker.0 Request processed in 26us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836756.227309:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836756.227374:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788836756.227396:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782962304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227408:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782962816:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227416:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730782963328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227437:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3617:1875730782961920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227445:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730782962432:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227453:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782962944:0@lo:400:kworker.0 00010000:00080000:2.0:1788836756.227467:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf463d9500 x1875730782963456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836756.227478:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782963456:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227571:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782962048:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227582:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782962560:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227590:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875730782963072:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227599:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782962176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836756.227614:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782962688:0@lo:400:kworker.0 00010000:00080000:2.0:1788836756.227636:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adf7fca9180 x1875730782963200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836756.227645:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782963200:0@lo:400:kworker.0 00000001:00100000:2.0:1788836756.227975:0:18686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2 00000001:00100000:2.0:1788836756.227984:0:18686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dda4d66-c699-4d7b-9c87-3e7b02502788 00000001:00100000:1.0:1788836756.245198:0:17161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2 00000001:00100000:1.0:1788836756.245214:0:17161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5dda4d66-c699-4d7b-9c87-3e7b02502788 00000100:00100000:1.0:1788836756.246575:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782963584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836756.246663:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836756.249269:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963584 00000100:00100000:1.0:1788836756.249285:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963584 00000100:00100000:1.0:1788836756.249347:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836756.249358:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782963584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836756.250819:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788836756.250904:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782963584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1548us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836756.250914:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836756.250973:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782963584:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788836756.251040:0:17914:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2 00000001:00100000:1.0:1788836756.251153:0:17914:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5dda4d66-c699-4d7b-9c87-3e7b02502788 00000100:00100000:1.0:1788836756.254314:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836756.254339:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782963712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836756.254415:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836756.254979:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782963712 00000100:00100000:3.0:1788836756.254987:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782963712 00000100:00100000:3.0:1788836756.255050:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836756.255060:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782963712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836756.255083:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788836756.255135:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782963712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836756.255143:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836756.256537:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782963712:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788836757.250162:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836757.440361:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.440396:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.440423:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.440442:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.440466:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836757.440528:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293376 00000100:00100000:0.0:1788836757.440537:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293376 00000100:00100000:3.0:1788836757.440554:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293120 00000100:00100000:3.0:1788836757.440558:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293120 00000100:00100000:3.0:1788836757.440593:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293632 00000100:00100000:0.0:1788836757.440594:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293888 00000100:00100000:3.0:1788836757.440596:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293632 00000100:00100000:0.0:1788836757.440596:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293888 00000100:00100000:3.0:1788836757.440630:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:0.0:1788836757.440630:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788836757.440639:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836757.440648:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2394:x1875730770293120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836757.440737:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2394:x1875730770293120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 88us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836757.440745:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788836757.440762:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1788836757.440768:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2394:x1875730770293632:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836757.440836:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1788836757.440846:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770293888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836757.444438:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 3787us (4028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836757.444452:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1788836757.444499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00080000:0.0:1788836757.444504:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836757.444509:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836757.444597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.444635:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.444652:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836757.444674:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293504 00000100:00100000:2.0:1788836757.444682:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293504 00000100:00100000:2.0:1788836757.444717:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294016 00000100:00100000:2.0:1788836757.444720:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294016 00000100:00100000:2.0:1788836757.444737:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836757.444746:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293504:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836757.444797:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293504:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836757.444803:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836757.444816:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788836757.444836:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2394:x1875730770294016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836757.444861:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2394:x1875730770294016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836757.444867:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788836757.444885:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293248 00000100:00100000:2.0:1788836757.444889:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293248 00000100:00100000:2.0:1788836757.444907:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770293760 00000100:00100000:2.0:1788836757.444909:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770293760 00000100:00100000:2.0:1788836757.444922:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:2.0:1788836757.444928:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836757.444968:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770293248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 40us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836757.444975:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:2.0:1788836757.444992:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788836757.444998:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770293760:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836757.445041:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770293760:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836757.445047:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788836757.445065:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770292992 00000100:00100000:2.0:1788836757.445069:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770292992 00000100:00100000:2.0:1788836757.445095:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:2.0:1788836757.445101:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770292992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836757.445124:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770292992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (4657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836757.445131:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:3.0:1788836757.445700:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2394:x1875730770293632:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 4928us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836757.445709:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788836757.446362:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770293888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 5515us (5916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836757.446372:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00080000:0.0:1788836757.447935:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836757.447942:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788836758.086918:0:20207:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1b4ac5a0 20000000:00000080:0.0:1788836758.086935:0:20207:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adf8054ac00 uarg=0000000000000000 20000000:01000000:0.0:1788836758.086977:0:20207:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788836758.086984:0:20207:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788836758.086989:0:20207:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788836758.089605:0:20208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788836758.089863:0:20207:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788836758.096427:0:20207:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788836758.096729:0:20207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096749:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096757:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096764:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555321 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096781:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096791:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096798:0:20207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096805:0:20207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096845:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.096859:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 12 pid: 17174 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.096873:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782963840:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836758.096993:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.097002:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.097037:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782963968:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836758.097066:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.097085:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.097094:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964096:0@lo:104: 00000100:00100000:1.0:1788836758.097128:0:20207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836758.097161:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.097168:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 23 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.097176:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44627800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964224:0@lo:104: 00000100:00100000:1.0:1788836758.097192:0:20207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836758.097212:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.097220:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 23 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.097227:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964352:0@lo:104: 00000100:00100000:1.0:1788836758.097242:0:20207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836758.097253:0:20207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 23 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.097261:0:20207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 23 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.097268:0:20207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964480:0@lo:104: 00000100:00100000:1.0:1788836758.097290:0:20207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836758.097298:0:20207:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836758.097426:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964096 00000100:00100000:3.0:1788836758.097432:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964096 00000100:00100000:3.0:1788836758.097464:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964224 00000100:00100000:3.0:1788836758.097467:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964224 00000100:00100000:3.0:1788836758.097474:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964352 00000100:00100000:3.0:1788836758.097476:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964352 00000100:00100000:3.0:1788836758.097494:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964480 00000100:00100000:3.0:1788836758.097497:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964480 00000100:00100000:3.0:1788836758.097508:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836758.097515:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:20207:x1875730782964096:12345-0@lo:104: 00010000:00010000:3.0:1788836758.097527:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097581:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836758.097596:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+6:20207:x1875730782964096:12345-0@lo:104: Request processed in 72us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.097604:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836758.097619:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836758.097630:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:20207:x1875730782964224:12345-0@lo:104: 00010000:00010000:3.0:1788836758.097646:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097676:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836758.097680:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+5:20207:x1875730782964224:12345-0@lo:104: Request processed in 51us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.097686:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836758.097696:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836758.097701:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:20207:x1875730782964352:12345-0@lo:104: 00010000:00010000:3.0:1788836758.097708:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097728:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788836758.097732:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+4:20207:x1875730782964352:12345-0@lo:104: Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.097737:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836758.097746:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836758.097751:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:20207:x1875730782964480:12345-0@lo:104: 00010000:00010000:3.0:1788836758.097756:0:17165:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097774:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788836758.097778:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+3:20207:x1875730782964480:12345-0@lo:104: Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.097783:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788836758.097795:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788836758.097805:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097812:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eba00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836758.097816:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097824:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836758.097831:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836758.097836:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836758.097860:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097866:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836758.097883:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097890:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf429eba00/0xf7b38383a6555486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a655548d expref: -99 pid: 19503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097903:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788836758.097906:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097911:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf7a700000 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836758.097914:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097929:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836758.097936:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836758.097941:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836758.097953:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097958:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836758.097963:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097969:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf7a700000/0xf7b38383a6555321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a6555328 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097977:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836758.097980:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097986:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615c200 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836758.097989:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.097996:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836758.098001:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836758.098048:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836758.098062:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098068:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836758.098081:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098088:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf6615c200/0xf7b38383a65552e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552e9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098098:0:17170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836758.098101:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098107:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615da00 already unused, calling callback (ffffffffc14d5c20) 10000000:00010000:3.0:1788836758.098110:0:17170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098116:0:17170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836758.098122:0:17170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836758.098126:0:17170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836758.098135:0:17170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098140:0:17170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836758.098150:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098156:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff8adf6615da00/0xf7b38383a65552d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7b38383a65552db expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098168:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836758.098170:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836758.098171:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836758.098178:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836758.098194:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782964608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098221:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836758.098248:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836758.098253:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782964736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836758.098378:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782964864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098398:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836758.098413:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836758.098418:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782964992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098432:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836758.098452:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964608 00000100:00100000:3.0:1788836758.098456:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964608 00010000:00010000:3.0:1788836758.098470:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 24 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836758.098483:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964736 00000100:00100000:3.0:1788836758.098485:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964736 00010000:00010000:3.0:1788836758.098492:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 25 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836758.098512:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964864 00000100:00100000:3.0:1788836758.098514:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964864 00010000:00010000:3.0:1788836758.098522:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 26 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836758.098529:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782964992 00000100:00100000:3.0:1788836758.098531:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782964992 00010000:00010000:3.0:1788836758.098538:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 27 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836758.098547:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836758.098552:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+27:3616:x1875730782964608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836758.098561:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836758.098565:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 27 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098574:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 27 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098602:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836758.098637:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+27:3616:x1875730782964608:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.098643:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836758.098654:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836758.098659:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+26:3616:x1875730782964736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836758.098666:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836758.098670:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 26 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098689:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 26 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098700:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836758.098722:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+26:3616:x1875730782964736:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.098728:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836758.098741:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836758.098747:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+25:3614:x1875730782964864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836758.098753:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836758.098757:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 25 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098765:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 25 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098774:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836758.098798:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+25:3614:x1875730782964864:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.098803:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836758.098813:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836758.098819:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782964992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836758.098826:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836758.098830:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 24 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098838:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 24 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.098853:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836758.098873:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782964992:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.098879:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836758.098916:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782964992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098925:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782964864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098946:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782964736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836758.098952:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade445c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3616:1875730782964608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836758.099248:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf77f46c00/0xf7b38383a655548d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6555486 expref: 23 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.099261:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964096:0@lo:104: 00010000:00010000:1.0:1788836758.099270:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf6615d000/0xf7b38383a6555328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a6555321 expref: 22 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.099279:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44627800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964224:0@lo:104: 00010000:00010000:1.0:1788836758.099287:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992400/0xf7b38383a65552e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65552e2 expref: 21 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.099296:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964352:0@lo:104: 00010000:00010000:1.0:1788836758.099303:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429eb800/0xf7b38383a65552db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7b38383a65552d4 expref: 20 pid: 17176 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.099312:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782964480:0@lo:104: 00000100:00100000:3.0:1788836758.102795:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836758.102860:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294144 00000100:00100000:0.0:1788836758.102870:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294144 00010000:00010000:0.0:1788836758.102908:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 13 pid: 17174 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836758.102951:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788836758.102960:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43926450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770294144:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836758.102973:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836758.102977:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 13 pid: 17174 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836758.102989:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 13 pid: 17174 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836758.103008:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836758.103090:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43926450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770294144:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836758.103097:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00010000:00010000:1.0:1788836758.104993:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade41f81c00/0xf7b38383a6555615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa721 expref: 12 pid: 17174 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836758.105038:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782963840:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836758.105054:0:20207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20207:1875730782963968:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836758.105088:0:20207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836758.111684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836758.111803:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294272 00000100:00100000:3.0:1788836758.111814:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294272 00010000:00010000:3.0:1788836758.111855:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836758.111886:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788836758.111896:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02a66b92-676f-4a0a-93db-5a4922690379+12:2395:x1875730770294272:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836758.111915:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836758.111922:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.111936:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.111956:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ade43992200/0xf7b38383a65555d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6b1 expref: 12 pid: 17175 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.111994:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112003:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112060:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112067:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112075:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112082:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112089:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836758.112093:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112102:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112118:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.112130:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836758.112183:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02a66b92-676f-4a0a-93db-5a4922690379+11:2395:x1875730770294272:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 287us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.112196:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00010000:00010000:1.0:1788836758.112552:0:20207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.112573:0:20207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836758.112580:0:20207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adf429ea800/0xf7b38383a6555646 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836758.270664:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788836758.272046:0:19504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2 00000100:00100000:0.0:1788836758.273156:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836758.273182:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782965120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836758.273260:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836758.273561:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965120 00000100:00100000:2.0:1788836758.273569:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965120 00000100:00100000:2.0:1788836758.273651:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836758.273663:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782965120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836758.273694:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836758.273818:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730782965120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836758.273826:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836758.273871:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875730782965120:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788836758.274140:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836758.782171:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836758.782195:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782965248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836758.782269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836758.782500:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965248 00000100:00100000:3.0:1788836758.782508:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965248 00000100:00100000:3.0:1788836758.782561:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836758.782571:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782965248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836758.782614:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788836758.782821:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782965248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836758.782829:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836758.785662:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782965248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788836759.298339:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836759.300238:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782965376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836759.300305:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836759.300366:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965376 00000100:00100000:3.0:1788836759.300373:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965376 00000100:00100000:3.0:1788836759.300420:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836759.300444:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782965376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836759.300604:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836759.300653:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782965376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 210us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836759.300661:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836759.300708:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782965376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836759.308005:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782965504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836759.308089:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836759.308146:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965504 00000100:00100000:2.0:1788836759.308154:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965504 00000100:00100000:2.0:1788836759.308209:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836759.308218:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782965504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836759.308239:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836759.308278:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782965504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836759.308285:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788836759.308304:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836759.308336:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782965504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836759.366868:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836759.367584:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294400 00000100:00100000:2.0:1788836759.367595:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294400 00000100:00100000:2.0:1788836759.367693:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788836759.367704:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+11:14932:x1875730770294400:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836759.367726:0:17176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836759.367745:0:17176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615d600/0xf7b38383a655564d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa759 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836759.367774:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615d600/0xf7b38383a655564d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa759 expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836759.367786:0:17176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615d600/0xf7b38383a655564d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa759 expref: 12 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836759.367795:0:17176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615d600, rc 0) 00000100:00100000:2.0:1788836759.367862:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294400:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836759.367870:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:3.0:1788836759.389523:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836759.390075:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294528 00000100:00100000:0.0:1788836759.390085:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294528 00000100:00100000:0.0:1788836759.390135:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:0.0:1788836759.390145:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294528:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836759.390285:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294528:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 140us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836759.390292:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:1.0:1788836759.395113:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836759.395184:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294656 00000100:00100000:2.0:1788836759.395194:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294656 00000100:00100000:2.0:1788836759.395254:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:2.0:1788836759.395264:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294656:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836759.395406:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294656:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836759.395415:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:0.0:1788836759.416882:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836759.416919:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294784 00000100:00100000:0.0:1788836759.416929:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294784 00000100:00100000:0.0:1788836759.416979:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:0.0:1788836759.416989:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+12:14932:x1875730770294784:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836759.417007:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836759.417044:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ade43993200/0xf7b38383a6555654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93c51954239fa760 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836759.417070:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ade43993200/0xf7b38383a6555654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa760 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836759.417081:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ade43993200/0xf7b38383a6555654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa760 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836759.417090:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993200, rc 0) 00000100:00100000:0.0:1788836759.417145:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02a66b92-676f-4a0a-93db-5a4922690379+13:14932:x1875730770294784:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836759.417161:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:2.0:1788836759.424957:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836759.425050:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770294912 00000100:00100000:1.0:1788836759.425062:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770294912 00000100:00100000:1.0:1788836759.425117:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:1.0:1788836759.425128:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:14932:x1875730770294912:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836759.425287:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:14932:x1875730770294912:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 161us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836759.425295:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1788836759.435626:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836759.435914:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295040 00000100:00100000:3.0:1788836759.435926:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295040 00000100:00100000:3.0:1788836759.435988:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:3.0:1788836759.436009:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:14932:x1875730770295040:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836759.436170:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02a66b92-676f-4a0a-93db-5a4922690379+13:14932:x1875730770295040:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 163us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836759.436179:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000040:00080000:0.0:1788836760.000306:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788836760.062383:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836760.062392:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf471d1000 from 13 10000000:01000000:1.0:1788836760.062397:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836760.062443:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.062467:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.062479:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.062506:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.062744:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.062800:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.062853:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965632 00000100:00100000:2.0:1788836760.062861:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965632 00000100:00100000:2.0:1788836760.062920:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836760.062929:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+20:17178:x1875730782965632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.062941:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836760.062961:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615c200/0xf7b38383a6555662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a655565b expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.062986:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615c200/0xf7b38383a6555662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a655565b expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.062998:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615c200/0xf7b38383a6555662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a655565b expref: 21 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.063007:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c200, rc 0) 00000100:00100000:2.0:1788836760.063096:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782965632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.063103:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788836760.063230:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836760.063244:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555662 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.063253:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555662 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.063310:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.063335:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.063365:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.063406:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965760 00000100:00100000:2.0:1788836760.063409:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965760 00000100:00100000:2.0:1788836760.063440:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836760.063548:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782965760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.064762:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782965760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1312us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.064772:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788836760.064869:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.064904:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.064942:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.064974:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836760.065045:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782965888 00000100:00100000:3.0:1788836760.065051:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782965888 00000100:00100000:3.0:1788836760.065085:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788836760.065093:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782965888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836760.065171:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782965888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836760.065177:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836760.065318:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782965888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836760.067152:0:20306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836760.067595:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836760.067618:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836760.067629:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555662 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.067641:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eaa00/0xf7b38383a655565b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555662 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836760.067652:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836760.067655:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adf770e7800 from 13 10000000:01000000:1.0:1788836760.067657:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836760.067702:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.067710:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.067720:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.067741:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.067798:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.067845:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.067933:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966016 00000100:00100000:2.0:1788836760.067940:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966016 00000100:00100000:2.0:1788836760.067987:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788836760.067996:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+21:17178:x1875730782966016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.068008:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836760.068050:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615da00/0xf7b38383a6555670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555669 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.068085:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615da00/0xf7b38383a6555670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555669 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.068095:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615da00/0xf7b38383a6555670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555669 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.068104:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615da00, rc 0) 00000100:00100000:2.0:1788836760.068145:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.068152:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836760.068432:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836760.068521:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555670 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.068531:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a6555670 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.068610:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.068637:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.068668:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.086487:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966144 00000100:00100000:2.0:1788836760.086501:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966144 00000100:00100000:2.0:1788836760.086566:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788836760.086576:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.086749:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (18109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.086757:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788836760.086813:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44624000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.086860:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.086913:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836760.086951:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836760.088467:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966272 00000100:00100000:1.0:1788836760.088478:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966272 00000100:00100000:1.0:1788836760.088522:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788836760.088531:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.088691:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836760.088708:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788836760.088969:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836760.091006:0:20307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836760.091232:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836760.091255:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836760.091267:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555670 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.091279:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eac00/0xf7b38383a6555669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a6555670 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836760.091290:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836760.091292:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade428c3000 from 13 10000000:01000000:1.0:1788836760.091295:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836760.091334:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.091343:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.091354:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.091380:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.091664:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.091708:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.092790:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966400 00000100:00100000:2.0:1788836760.092800:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966400 00000100:00100000:2.0:1788836760.092865:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788836760.092875:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+22:17178:x1875730782966400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.092890:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836760.092905:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615c000/0xf7b38383a655567e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555677 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.092930:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615c000/0xf7b38383a655567e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555677 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.092941:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615c000/0xf7b38383a655567e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555677 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.092949:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615c000, rc 0) 00000100:00100000:2.0:1788836760.093003:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.093028:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788836760.093076:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.093090:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655567e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.093100:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655567e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836760.093181:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.093207:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836760.093230:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf5169e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.093242:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966528 00000100:00100000:2.0:1788836760.093245:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966528 00000100:00100000:2.0:1788836760.093270:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788836760.093275:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.093384:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.093391:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788836760.093417:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.093441:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.094664:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836760.094696:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.095201:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966656 00000100:00100000:2.0:1788836760.095207:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966656 00000100:00100000:2.0:1788836760.095242:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788836760.095247:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.095335:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.095340:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788836760.095538:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836760.096975:0:20308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836760.097061:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836760.097083:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836760.097094:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655567e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.097118:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429eb600/0xf7b38383a6555677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655567e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836760.097129:0:17178:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836760.097131:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ade44565800 from 13 10000000:01000000:1.0:1788836760.097134:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836760.097166:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.097174:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.097183:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836760.097204:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836760.097252:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836760.097293:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.097791:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966784 00000100:00100000:2.0:1788836760.097800:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966784 00000100:00100000:2.0:1788836760.097854:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788836760.097863:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+23:17178:x1875730782966784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.097886:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836760.097900:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adf6615ce00/0xf7b38383a655568c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7b38383a6555685 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.098214:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adf6615ce00/0xf7b38383a655568c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7b38383a6555685 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.098224:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adf6615ce00/0xf7b38383a655568c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7b38383a6555685 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.098233:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf6615ce00, rc 0) 00000100:00100000:2.0:1788836760.098283:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782966784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.098290:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788836760.098336:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44625180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836760.098352:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655568c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836760.098361:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7b38383a655568c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836760.098417:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.098445:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836760.098468:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.098481:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782966912 00000100:00100000:2.0:1788836760.098484:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782966912 00000100:00100000:2.0:1788836760.098508:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836760.098514:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782966912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.098629:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782966912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.098645:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836760.098761:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782966912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.098789:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782967040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.098828:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836760.098842:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836760.098853:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967040 00000100:00100000:2.0:1788836760.098856:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967040 00000100:00100000:2.0:1788836760.098876:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836760.098882:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782967040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836760.098963:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:17178:x1875730782967040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836760.098969:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836760.099007:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:17178:1875730782967040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836760.099648:0:20309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836760.101629:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836760.101662:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836760.101674:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655568c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836760.101686:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff8adf429ea400/0xf7b38383a6555685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7b38383a655568c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836760.318292:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836761.328899:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.329074:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295168 00000100:00100000:2.0:1788836761.329084:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295168 00000100:00100000:2.0:1788836761.329167:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1788836761.329179:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:15601:x1875730770295168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836761.329203:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.329228:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa767 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329310:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788836761.329469:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788836761.329816:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329833:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329851:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329860:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329866:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329944:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031c00/0xf7b38383a65556a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329952:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031c00/0xf7b38383a65556a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.329969:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031c00/0xf7b38383a65556a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.330001:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836761.330006:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836761.330088:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031c00/0xf7b38383a65556a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330097:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330112:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330117:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330120:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615de00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.330123:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330128:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330137:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:2.0:1788836761.330139:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836761.330142:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330146:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615de00/0xf7b38383a655569a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330159:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330162:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330167:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330172:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf6615d800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.330180:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330186:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330193:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8adf45408d00) 00010000:00010000:2.0:1788836761.330196:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836761.330199:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330205:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d800/0xf7b38383a65556a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330240:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615d000/0xf7b38383a6555693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa767 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330252:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031c00/0xf7b38383a65556a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa767 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.330259:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adf45408c00) 00010000:00010000:2.0:1788836761.330261:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836761.330263:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031c00, rc 0) 00000100:00100000:2.0:1788836761.330337:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15601:x1875730770295168:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1159us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.330832:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1788836761.339639:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.339731:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295296 00000100:00100000:3.0:1788836761.339740:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295296 00000100:00100000:3.0:1788836761.339819:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1788836761.339828:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15601:x1875730770295296:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788836761.339895:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15601:x1875730770295296:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.339900:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1788836761.342570:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782967168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836761.342654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836761.342857:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967168 00000100:00100000:0.0:1788836761.342865:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967168 00000100:00100000:0.0:1788836761.342926:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836761.342937:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782967168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836761.342973:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00010000:00010000:3.0:1788836761.343157:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836761.343179:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836761.343691:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782967296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836761.343722:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.343757:0:18694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788836761.343765:0:18694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788836761.346315:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782967680:0@lo:400:kworker.0 00000100:00100000:1.0:1788836761.346398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836761.346837:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782967168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3899us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.346850:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836761.346879:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967296 00000100:00100000:0.0:1788836761.346887:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967296 00000100:00100000:0.0:1788836761.346930:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836761.346939:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782967296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836761.346963:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788836761.347024:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782967296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (3285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.347031:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788836761.347065:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836761.347103:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf7fca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782967296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836761.347165:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967680 00000100:00100000:0.0:1788836761.347169:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967680 00000100:00100000:0.0:1788836761.347201:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836761.347208:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782967680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836761.347254:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782967680:12345-0@lo:400:kworker.0 Request processed in 47us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.347262:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788836761.347280:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836761.347303:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782967424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836761.347334:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836761.348021:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782967168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836761.348052:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782967680:0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.348210:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782967552:0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.348252:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836761.348301:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967552 00000100:00100000:2.0:1788836761.348305:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967552 00000100:00100000:2.0:1788836761.348337:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836761.348357:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.348402:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875730782967552:12345-0@lo:400:kworker.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.348410:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836761.348778:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875730782967552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836761.349447:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836761.349460:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782967808:0@lo:400:kworker.0 00000100:00100000:0.0:1788836761.349509:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836761.349550:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967808 00000100:00100000:0.0:1788836761.349557:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967808 00000100:00100000:0.0:1788836761.349593:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788836761.349600:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782967808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836761.349641:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875730782967808:12345-0@lo:400:kworker.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.349648:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788836761.349676:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875730782967808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350003:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782968064:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350070:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.350092:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782968576:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350114:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.350131:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788836761.350136:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782967936:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350159:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.350175:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782968448:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350196:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.350222:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968064 00000100:00100000:3.0:1788836761.350227:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968064 00000100:00100000:3.0:1788836761.350264:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836761.350270:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf476c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782968064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350306:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf476c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782968064:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.350312:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836761.350803:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967936 00000100:00100000:3.0:1788836761.350808:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967936 00000100:00100000:3.0:1788836761.350836:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836761.350843:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782967936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350878:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782967936:12345-0@lo:400:kworker.0 Request processed in 35us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.350884:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836761.350902:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968576 00000100:00100000:3.0:1788836761.350905:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968576 00000100:00100000:3.0:1788836761.350928:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968448 00000100:00100000:3.0:1788836761.350930:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968448 00000100:00100000:3.0:1788836761.350951:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836761.350965:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.350995:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875730782968576:12345-0@lo:400:kworker.0 Request processed in 32us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.351001:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836761.351034:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836761.351041:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782968448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351068:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875730782968448:12345-0@lo:400:kworker.0 Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.351074:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836761.351107:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782967936:0@lo:400:kworker.0 00010000:00080000:3.0:1788836761.351119:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f0a80 x1875730782968448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836761.351129:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875730782968448:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351139:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782968064:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351148:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875730782968576:0@lo:400:kworker.0 00000100:00080000:3.0:1788836761.351180:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836761.351184:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836761.351187:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836761.351199:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782968320:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351223:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.351243:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788836761.351248:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782968192:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351268:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.351283:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782968704:0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.351311:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836761.351333:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968320 00000100:00100000:3.0:1788836761.351337:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968320 00000100:00100000:3.0:1788836761.353303:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968192 00000100:00100000:3.0:1788836761.353316:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968192 00000100:00100000:3.0:1788836761.353331:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782968704 00000100:00100000:3.0:1788836761.353334:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782968704 00000100:00100000:2.0:1788836761.353466:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.353707:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295552 00000100:00100000:2.0:1788836761.353711:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295552 00000100:00100000:2.0:1788836761.353735:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836761.353743:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782968320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.353809:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730782968320:12345-0@lo:400:kworker.0 Request processed in 66us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.353815:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836761.353829:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836761.353835:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782968192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.353858:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730782968192:12345-0@lo:400:kworker.0 Request processed in 25us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.353864:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836761.353875:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:2.0:1788836761.353880:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15601:x1875730770295552:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836761.353893:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.353914:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65556af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa76e expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.353999:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354037:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354048:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354106:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354114:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354121:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354215:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65556c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354223:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65556c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354229:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65556c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.354238:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788836761.354393:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354411:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354418:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354748:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.354753:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354760:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354773:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adf45408c00) 00010000:00010000:2.0:1788836761.354775:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836761.354780:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354786:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a65556b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354800:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354807:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354812:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354817:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.354828:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354835:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354843:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8adf45408d00) 00010000:00010000:2.0:1788836761.354846:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836761.354848:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.354854:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65556bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.355300:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730782968192:0@lo:400:kworker.0 00000100:00100000:2.0:1788836761.355314:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730782968320:0@lo:400:kworker.0 00000100:00100000:1.0:1788836761.357410:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782967424 00000100:00100000:1.0:1788836761.357441:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782967424 00000100:00100000:1.0:1788836761.357528:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836761.357547:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782967424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836761.357651:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782967424:12345-0@lo:400:kworker.0 Request processed in 106us (10316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836761.357658:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788836761.357722:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782967424:0@lo:400:kworker.0 00010000:00010000:1.0:1788836761.359713:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65556af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa76e expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.359742:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030400/0xf7b38383a65556c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa76e expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.359752:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adf45408300) 00010000:00010000:1.0:1788836761.359755:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836761.359758:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030400, rc 0) 00000100:00100000:1.0:1788836761.359827:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15601:x1875730770295552:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 5945us (6364us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788836761.359836:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00080000:0.0:1788836761.365150:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836761.365162:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836761.365417:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836761.365445:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782968704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836761.365805:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730782968704:12345-0@lo:400:kworker.0 Request processed in 371us (14491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.365814:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788836761.365928:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade439f2d80 x1875730782968704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836761.365943:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade439f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730782968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788836761.383793:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.383897:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295680 00000100:00100000:2.0:1788836761.383908:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295680 00000100:00100000:2.0:1788836761.383981:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788836761.383992:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15601:x1875730770295680:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788836761.384138:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15601:x1875730770295680:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 147us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.384146:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788836761.398677:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.398892:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295808 00000100:00100000:3.0:1788836761.398903:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295808 00000100:00100000:2.0:1788836761.399199:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:2.0:1788836761.399212:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:15601:x1875730770295808:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788836761.399460:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788836761.402754:0:17183:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3494us 00000100:00100000:1.0:1788836761.414257:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.417063:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770295936 00000100:00100000:3.0:1788836761.417081:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770295936 00000100:00100000:3.0:1788836761.417156:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836761.417181:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15607:x1875730770295936:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836761.417207:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836761.417237:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa775 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417300:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417315:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417351:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417369:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417379:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417385:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417450:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417458:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417464:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417475:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.417479:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417486:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417497:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:3.0:1788836761.417500:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.417505:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417517:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a65556d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417560:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417570:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417576:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417581:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f80e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.417584:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417591:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417599:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:3.0:1788836761.417602:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.417604:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417610:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417644:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa775 expref: 10 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417955:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:3.0:1788836761.417958:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.417963:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa775 expref: 10 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.417973:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81400, rc 0) 00000100:00100000:3.0:1788836761.418087:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15607:x1875730770295936:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 911us (3837us total) trans 0 rc 301/301 00000100:00100000:3.0:1788836761.418095:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836761.424307:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.424431:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296064 00000100:00100000:1.0:1788836761.424440:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296064 00000100:00100000:1.0:1788836761.424495:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788836761.424506:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15607:x1875730770296064:12345-192.168.201.38@tcp:700:lfs.0 00000100:00100000:1.0:1788836761.424592:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15607:x1875730770296064:12345-192.168.201.38@tcp:700:lfs.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836761.424600:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788836761.427878:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.429540:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:15601:x1875730770295808:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 30315us (30857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836761.429554:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:1.0:1788836761.429585:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296320 00000100:00100000:1.0:1788836761.429591:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296320 00000100:00100000:1.0:1788836761.429633:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836761.429643:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:15607:x1875730770296320:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:1.0:1788836761.429689:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836761.429718:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993600/0xf7b38383a6555600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa6e2 expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.429734:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:1.0:1788836761.429740:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836761.429802:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.429822:0:17183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.429831:0:17183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.429863:0:17183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.429877:0:17183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 5 pid: 17181 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836761.429891:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17183:1875730782968832:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836761.429940:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf773370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836761.435330:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.435445:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade44626300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17183:1875730782968832:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836761.435471:0:17183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.435575:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296448 00000100:00100000:2.0:1788836761.435594:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296448 00010000:00010000:2.0:1788836761.435646:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 6 pid: 17181 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.435684:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1788836761.435694:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:2394:x1875730770296448:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836761.435709:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836761.435716:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 6 pid: 17181 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435729:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 6 pid: 17181 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435751:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf6615ca00/0xf7b38383a655563f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa752 expref: 6 pid: 17181 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435767:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:2.0:1788836761.435772:0:17168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435781:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435789:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.435808:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836761.435861:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770296448:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 169us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.435878:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00010000:00010000:3.0:1788836761.436284:0:17183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.436293:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.436318:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.436327:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.436335:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836761.436671:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836761.437897:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.437913:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.437922:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836761.437939:0:17183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b861f56f reply state 000000000361f47a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.437950:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.437956:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:3.0:1788836761.437959:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836761.438039:0:17183:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788836761.438045:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788836761.438054:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438060:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438066:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438071:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ebe00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.438075:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438088:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438098:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ade43819f00) 00010000:00010000:3.0:1788836761.438101:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.438104:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438110:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a65556e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836761.438128:0:17183:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b861f56f reply state 000000000361f47a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438135:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.438141:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:3.0:1788836761.438143:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836761.438145:0:17183:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788836761.438231:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+10:15607:x1875730770296320:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 8586us (10359us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788836761.438239:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836761.538633:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.538721:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296576 00000100:00100000:3.0:1788836761.538731:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296576 00000100:00100000:3.0:1788836761.538790:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1788836761.538802:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+10:15615:x1875730770296576:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:3.0:1788836761.538828:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836761.538849:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa77c expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.538928:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a6555703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.538942:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a6555703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.538953:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a6555703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836761.538995:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836761.538999:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836761.539073:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a6555703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.539096:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a65556fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa77c expref: 12 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.539112:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81000/0xf7b38383a6555703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa77c expref: 11 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.539120:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:3.0:1788836761.539123:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836761.539126:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81000, rc 0) 00000100:00100000:3.0:1788836761.539185:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+11:15615:x1875730770296576:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 387us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.539192:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1788836761.559980:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.561819:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296704 00000100:00100000:1.0:1788836761.561834:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296704 00000100:00100000:1.0:1788836761.561916:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:1.0:1788836761.561927:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:15616:x1875730770296704:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836761.561948:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836761.561969:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a655570a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa783 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562070:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6555711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562101:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6555711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562112:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6555711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836761.562160:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788836761.562164:0:17182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836761.562187:0:17182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6555711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562210:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a655570a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa783 expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562232:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eba00/0xf7b38383a6555711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa783 expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.562239:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:1.0:1788836761.562243:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836761.562246:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eba00, rc 0) 00000100:00100000:1.0:1788836761.562329:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15616:x1875730770296704:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 403us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836761.562337:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:2.0:1788836761.572855:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.572978:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296832 00000100:00100000:3.0:1788836761.572989:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296832 00000100:00100000:3.0:1788836761.573150:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1788836761.573160:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+6:15616:x1875730770296832:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836761.573179:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836761.573199:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa78a expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573259:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573275:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573298:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573310:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573317:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573324:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573401:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573410:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573417:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836761.573481:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836761.573485:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836761.573503:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573515:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573521:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573538:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573544:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.573548:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573556:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573567:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:3.0:1788836761.573571:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.573575:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573581:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655571f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573594:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573610:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573615:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573620:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.573623:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573629:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573637:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:3.0:1788836761.573640:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.573642:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573648:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a6555726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573673:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa78a expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573686:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa78a expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.573694:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:3.0:1788836761.573696:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836761.573705:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f80a00, rc 0) 00000100:00100000:3.0:1788836761.573766:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+7:15616:x1875730770296832:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 607us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.573773:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1788836761.576403:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836761.576926:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770296960 00000100:00100000:0.0:1788836761.576937:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770296960 00000100:00100000:0.0:1788836761.577183:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788836761.577195:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:15616:x1875730770296960:12345-192.168.201.38@tcp:900:lfs.0 00000100:00100000:0.0:1788836761.577294:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:15616:x1875730770296960:12345-192.168.201.38@tcp:900:lfs.0 Request processed in 101us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.577316:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00080000:3.0:1788836761.577408:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836761.586820:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.587057:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770297216 00000100:00100000:1.0:1788836761.587068:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770297216 00000100:00100000:1.0:1788836761.587132:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1788836761.587143:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+7:15616:x1875730770297216:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836761.587166:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836761.587205:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa791 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836761.587322:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788836761.587451:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555734 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa791 expref: 9 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.587465:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:1.0:1788836761.587467:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836761.587472:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa791 expref: 9 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.587497:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836761.587564:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+8:15616:x1875730770297216:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 422us (752us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788836761.587572:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1788836761.591277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.591364:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770297472 00000100:00100000:2.0:1788836761.591374:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770297472 00000100:00100000:2.0:1788836761.591564:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788836761.591575:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+8:15616:x1875730770297472:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:2.0:1788836761.591629:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836761.591656:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80a00/0xf7b38383a655572d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa78a expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.591674:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:2.0:1788836761.591679:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836761.591700:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.591713:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.591722:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836761.591917:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cffe0b50 reply state 000000002bb1c76f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.591930:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.591949:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:2.0:1788836761.591965:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788836761.591969:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836761.591976:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788836761.592073:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+9:15616:x1875730770297472:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 500us (806us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788836761.592080:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788836761.594329:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836761.594405:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770297728 00000100:00100000:0.0:1788836761.594414:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770297728 00000100:00100000:0.0:1788836761.594479:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1788836761.594496:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+9:15616:x1875730770297728:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836761.594724:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+10:15616:x1875730770297728:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 227us (402us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788836761.594731:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1788836761.597200:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.597290:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770297984 00000100:00100000:1.0:1788836761.597299:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770297984 00000100:00100000:1.0:1788836761.597402:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788836761.597411:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+10:15616:x1875730770297984:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788836761.597446:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836761.597465:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa798 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597560:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597574:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597599:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597613:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597620:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597626:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836761.597732:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788836761.597807:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597814:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597820:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597826:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ebe00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836761.597830:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597837:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597849:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:1.0:1788836761.597851:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836761.597862:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597867:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597883:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597888:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597894:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597899:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836761.597901:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597907:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597915:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:1.0:1788836761.597917:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836761.597920:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597926:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a6555757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597957:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa798 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597980:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:1.0:1788836761.597983:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836761.597988:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa798 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836761.597998:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf429eb800, rc 0) 00000100:00100000:1.0:1788836761.598104:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade4390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+11:15616:x1875730770297984:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 693us (912us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788836761.598112:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:2.0:1788836761.600790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.600900:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770298112 00000100:00100000:3.0:1788836761.600911:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770298112 00000100:00100000:3.0:1788836761.600968:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1788836761.600977:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+11:15616:x1875730770298112:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788836761.600999:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836761.601045:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555765 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa79f expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601129:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601142:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601153:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836761.601173:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836761.601176:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836761.601193:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601218:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555765 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 13 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601234:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 12 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.601255:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:3.0:1788836761.601258:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836761.601262:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81200, rc 0) 00000100:00100000:3.0:1788836761.601308:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:15616:x1875730770298112:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 333us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.601315:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788836761.606234:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836761.606304:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770298240 00000100:00100000:0.0:1788836761.606313:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770298240 00000100:00100000:0.0:1788836761.606371:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788836761.606381:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:15616:x1875730770298240:12345-192.168.201.38@tcp:37:lfs.0 00000100:00100000:2.0:1788836761.613715:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:15616:x1875730770298240:12345-192.168.201.38@tcp:37:lfs.0 Request processed in 7327us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.613729:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1788836761.620647:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.620704:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770298496 00000100:00100000:3.0:1788836761.620714:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770298496 00000100:00100000:3.0:1788836761.620773:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788836761.620783:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:15616:x1875730770298496:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788836761.621096:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42b3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+13:15616:x1875730770298496:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 313us (459us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788836761.621104:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1788836761.666588:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836761.666761:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770298624 00000100:00100000:3.0:1788836761.666772:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770298624 00000100:00100000:3.0:1788836761.666890:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1788836761.666902:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+11:15622:x1875730770298624:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788836761.666927:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836761.666964:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7a6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667071:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667086:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667114:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667126:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667134:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667141:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667230:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81a00/0xf7b38383a6555788 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667240:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81a00/0xf7b38383a6555788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667246:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81a00/0xf7b38383a6555788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836761.667280:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836761.667284:0:17183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836761.667323:0:17183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81a00/0xf7b38383a6555788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667335:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667342:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667358:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667364:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.667368:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667376:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667388:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:3.0:1788836761.667391:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.667396:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667401:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a655577a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667413:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667433:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667440:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667445:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f80000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836761.667448:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667463:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667472:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:3.0:1788836761.667474:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836761.667478:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667494:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80000/0xf7b38383a6555781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667521:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7a6 expref: 13 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667546:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81a00/0xf7b38383a6555788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7a6 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.667553:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:3.0:1788836761.667556:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788836761.667558:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81a00, rc 0) 00000100:00100000:3.0:1788836761.667629:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+12:15622:x1875730770298624:12345-192.168.201.38@tcp:101:bash.0 Request processed in 730us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.667637:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1788836761.670178:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.670368:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770298752 00000100:00100000:1.0:1788836761.670378:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770298752 00000100:00100000:1.0:1788836761.670492:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788836761.670504:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:15622:x1875730770298752:12345-192.168.201.38@tcp:900:bash.0 00000100:00100000:1.0:1788836761.670603:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:15622:x1875730770298752:12345-192.168.201.38@tcp:900:bash.0 Request processed in 101us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836761.670611:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788836761.672834:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.672918:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770299008 00000100:00100000:2.0:1788836761.672927:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770299008 00000100:00100000:2.0:1788836761.673053:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1788836761.673064:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+12:15622:x1875730770299008:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836761.673083:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.673105:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a655578f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7ad expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.673227:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.673243:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 12 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.673270:0:17181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.673307:0:17181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 12 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.673321:0:17181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 12 pid: 18652 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.673334:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17181:1875730782968960:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836761.673402:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf4b70d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836761.676560:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836761.676658:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770299136 00000100:00100000:0.0:1788836761.676667:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770299136 00010000:00010000:0.0:1788836761.676701:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 13 pid: 18652 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836761.676734:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788836761.676741:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+13:2395:x1875730770299136:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836761.676751:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836761.676756:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 13 pid: 18652 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836761.676780:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 13 pid: 18652 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836761.676798:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:0.0:1788836761.676802:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836761.676808:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836761.676814:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836761.676827:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836761.676871:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+13:2395:x1875730770299136:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 131us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836761.676876:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00010000:00010000:2.0:1788836761.676988:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81200/0xf7b38383a655576c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa79f expref: 12 pid: 18652 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.677005:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17181:1875730782968960:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836761.677070:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677077:0:17181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677082:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677100:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677105:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677115:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677726:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677737:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677745:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.677757:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836761.677782:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677790:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677796:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677802:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.677806:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677814:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677824:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:2.0:1788836761.677832:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836761.677848:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677854:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555796 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836761.677864:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003145773d reply state 000000000b974387 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677874:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677880:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8adf45408d00) 00010000:00010000:2.0:1788836761.677882:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836761.677884:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788836761.677918:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a655578f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 15 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677933:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 14 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.677940:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836761.677942:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788836761.677944:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031800, rc 0) 00000100:00100000:2.0:1788836761.677982:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+15:15622:x1875730770299008:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4921us (5156us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788836761.677990:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:0.0:1788836761.689755:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.690037:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770299264 00000100:00100000:2.0:1788836761.690047:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770299264 00000100:00100000:2.0:1788836761.690096:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1788836761.690104:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+15:15622:x1875730770299264:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788836761.690136:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.690152:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7b4 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690264:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690276:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690283:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.690321:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788836761.690325:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836761.690338:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690345:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690362:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 17 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690375:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 16 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.690393:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836761.690395:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836761.690397:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030a00, rc 0) 00000100:00100000:2.0:1788836761.690464:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+16:15622:x1875730770299264:12345-192.168.201.38@tcp:101:bash.0 Request processed in 359us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.690472:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:1.0:1788836761.700471:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.700575:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770299520 00000100:00100000:2.0:1788836761.700585:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770299520 00000100:00100000:2.0:1788836761.700648:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1788836761.700658:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+16:15622:x1875730770299520:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788836761.700971:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+17:15622:x1875730770299520:12345-192.168.201.38@tcp:35:bash.0 Request processed in 313us (509us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788836761.700979:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1788836761.781272:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.781900:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770299776 00000100:00100000:2.0:1788836761.781911:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770299776 00000100:00100000:2.0:1788836761.781981:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788836761.781992:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+17:15632:x1875730770299776:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836761.782056:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.782077:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7bb expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.782217:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836761.782315:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7bb expref: 19 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.782330:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adf46934c00) 00010000:00010000:2.0:1788836761.782332:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836761.782338:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7bb expref: 19 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.782362:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030800, rc 0) 00000100:00100000:2.0:1788836761.782629:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+18:15632:x1875730770299776:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 638us (1364us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788836761.782637:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:1.0:1788836761.788958:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.789074:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770300032 00000100:00100000:2.0:1788836761.789084:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770300032 00000100:00100000:2.0:1788836761.789141:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1788836761.789150:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+18:15632:x1875730770300032:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788836761.789745:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15632:x1875730770300032:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 593us (802us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788836761.789755:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000040:00080000:2.0:1788836761.791933:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836761.835811:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.835922:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770300288 00000100:00100000:2.0:1788836761.835933:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770300288 00000100:00100000:2.0:1788836761.836003:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1788836761.836050:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15635:x1875730770300288:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788836761.836076:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836761.836096:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7c2 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.836198:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65557d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.836214:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65557d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.836242:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65557d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836761.836254:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836761.836352:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c2 expref: 22 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.836371:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65557d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c2 expref: 21 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.836381:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836761.836384:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836761.836388:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836761.836464:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15635:x1875730770300288:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 452us (663us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788836761.836472:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:1.0:1788836761.842811:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836761.842849:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836761.842905:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770300544 00000100:00100000:2.0:1788836761.842913:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770300544 00000100:00100000:2.0:1788836761.842969:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:2.0:1788836761.842977:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15635:x1875730770300544:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1788836761.843078:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843093:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843103:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843158:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843165:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843172:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843178:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836761.843184:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843191:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843204:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836761.843207:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836761.843212:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836761.843217:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836761.843289:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15635:x1875730770300544:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 311us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836761.843296:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:3.0:1788836761.843911:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770300416 00000100:00100000:3.0:1788836761.843917:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770300416 00000100:00100000:3.0:1788836761.843958:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1788836761.843971:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:2394:x1875730770300416:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836761.843980:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836761.843994:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a65557d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c2 expref: 21 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836761.844002:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:3.0:1788836761.844005:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836761.844057:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+20:2394:x1875730770300416:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 87us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836761.844062:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788836761.850630:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836761.850731:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770300800 00000100:00100000:0.0:1788836761.850742:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770300800 00000100:00100000:0.0:1788836761.850805:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788836761.850816:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+20:15635:x1875730770300800:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788836761.851246:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15635:x1875730770300800:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 430us (627us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788836761.851255:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000040:00080000:3.0:1788836762.069397:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836762.137839:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.137972:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301056 00000100:00100000:2.0:1788836762.137982:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301056 00000100:00100000:2.0:1788836762.138090:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:2.0:1788836762.138107:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15666:x1875730770301056:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788836762.138134:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836762.138153:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7c9 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.138276:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.138291:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.138306:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836762.138319:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836762.138457:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a65557ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c9 expref: 24 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.138670:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c9 expref: 23 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.138679:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.138682:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836762.138685:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031a00, rc 0) 00000100:00100000:2.0:1788836762.138747:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:15666:x1875730770301056:12345-192.168.201.38@tcp:101:cat.0 Request processed in 641us (918us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788836762.138754:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788836762.146219:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.146301:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.146394:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301184 00000100:00100000:2.0:1788836762.146405:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301184 00000100:00100000:2.0:1788836762.146510:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1788836762.146530:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:2395:x1875730770301184:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836762.146550:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836762.146581:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7c9 expref: 23 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.146603:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.146609:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836762.146666:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+22:2395:x1875730770301184:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 146us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.146674:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1788836762.148152:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301440 00000100:00100000:0.0:1788836762.148167:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301440 00000100:00100000:0.0:1788836762.148352:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788836762.148363:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+22:15666:x1875730770301440:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:0.0:1788836762.148895:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:15666:x1875730770301440:12345-192.168.201.38@tcp:35:cat.0 Request processed in 532us (2591us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788836762.148903:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1788836762.225105:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.225336:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301696 00000100:00100000:2.0:1788836762.225347:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301696 00000100:00100000:2.0:1788836762.225410:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788836762.225433:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:15672:x1875730770301696:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:2.0:1788836762.225458:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836762.225480:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7d0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225603:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225620:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225630:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 24 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225657:0:17182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225692:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 24 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225707:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 24 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.225719:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969088:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836762.225811:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.225820:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.225829:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969216:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836762.225851:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65d65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836762.232847:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.233660:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301824 00000100:00100000:0.0:1788836762.233670:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301824 00010000:00010000:0.0:1788836762.233711:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 25 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.233756:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788836762.233765:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+25:2394:x1875730770301824:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836762.233780:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836762.233786:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 25 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.233800:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 25 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.233820:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:0.0:1788836762.233825:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.233833:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.233839:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836762.233898:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+25:2394:x1875730770301824:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 134us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.233920:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00010000:00010000:2.0:1788836762.234513:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a65557b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7b4 expref: 24 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.234540:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969088:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836762.234553:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969216:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788836762.234573:0:17182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836762.235390:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.235583:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770301952 00000100:00100000:1.0:1788836762.235591:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770301952 00010000:00010000:1.0:1788836762.235621:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.235654:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788836762.235662:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43926c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+24:2394:x1875730770301952:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836762.235674:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836762.235679:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235691:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235710:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031800/0xf7b38383a65557a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ad expref: 24 pid: 17181 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235724:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:1.0:1788836762.235729:0:17166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235738:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235746:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.235769:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836762.235820:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43926c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:2394:x1875730770301952:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 158us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.235827:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00010000:00010000:2.0:1788836762.235903:0:17182:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.235911:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836762.235928:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836762.236099:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a65557ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d0 expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.236113:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030800/0xf7b38383a6555806 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d0 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.236120:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.236123:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836762.236125:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030800, rc 0) 00000100:00100000:2.0:1788836762.236148:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:15672:x1875730770301696:12345-192.168.201.38@tcp:101:dd.0 Request processed in 10730us (11056us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788836762.236154:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1788836762.242383:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.242458:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302080 00000100:00100000:2.0:1788836762.242472:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302080 00000100:00100000:2.0:1788836762.242550:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:2.0:1788836762.242558:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+23:15672:x1875730770302080:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:2.0:1788836762.242580:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836762.242596:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555814 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7d7 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242640:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242651:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242659:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242743:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555814 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 25 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242755:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 24 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.242761:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.242763:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836762.242765:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40030000, rc 0) 00000100:00100000:2.0:1788836762.242818:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+24:15672:x1875730770302080:12345-192.168.201.38@tcp:101:dd.0 Request processed in 262us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.242823:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788836762.244885:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.244955:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302336 00000100:00100000:1.0:1788836762.244963:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302336 00000100:00100000:1.0:1788836762.245047:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1788836762.245056:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+24:15672:x1875730770302336:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:1.0:1788836762.245296:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.245310:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.245318:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836762.245358:0:17181:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788836762.245377:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c58c8f14 reply state 000000006e7f3214 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.245387:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.245392:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:1.0:1788836762.245394:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836762.245397:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836762.245504:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302336:12345-192.168.201.38@tcp:36:dd.0 Request processed in 450us (625us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788836762.245509:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000020:00080000:1.0:1788836762.245529:0:17181:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788836762.246898:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.246947:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302464 00000100:00100000:2.0:1788836762.246956:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302464 00000100:00100000:2.0:1788836762.247000:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1788836762.247129:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302464:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:2.0:1788836762.247157:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836762.247174:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a6555829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7de expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.247242:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a6555829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7de expref: 28 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.247257:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a6555829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7de expref: 28 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.247277:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.247281:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836762.247284:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf40031a00, rc 0) 00000100:00100000:2.0:1788836762.247335:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15672:x1875730770302464:12345-192.168.201.38@tcp:101:dd.0 Request processed in 326us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.247342:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788836762.254827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.255263:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302720 00000100:00100000:2.0:1788836762.255274:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302720 00000100:00100000:2.0:1788836762.255327:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788836762.255334:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15672:x1875730770302720:12345-192.168.201.38@tcp:103:dd.0 00010000:00010000:2.0:1788836762.255346:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836762.255368:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a6555829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7de expref: 28 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.255388:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836762.255392:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836762.255708:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302720:12345-192.168.201.38@tcp:103:dd.0 Request processed in 373us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.255714:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788836762.257685:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.257732:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302848 00000100:00100000:1.0:1788836762.257741:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302848 00000100:00100000:1.0:1788836762.257810:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788836762.257817:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302848:12345-192.168.201.38@tcp:58:dd.0 00010000:00010000:1.0:1788836762.257908:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.257921:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.257930:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836762.258751:0:17181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836762.258984:0:17181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788836762.259126:0:17181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788836762.259332:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302848:12345-192.168.201.38@tcp:58:dd.0 Request processed in 1512us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.259342:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788836762.261405:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.261556:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770302976 00000100:00100000:3.0:1788836762.261567:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770302976 00000100:00100000:3.0:1788836762.261635:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1788836762.261645:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+27:15672:x1875730770302976:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836762.261665:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836762.261684:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7e5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261746:0:17183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261764:0:17183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261778:0:17183:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261787:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261797:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:3.0:1788836762.261800:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836762.261802:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 28 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.261807:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f80e00, rc 0) 00000100:00100000:3.0:1788836762.261985:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15672:x1875730770302976:12345-192.168.201.38@tcp:101:dd.0 Request processed in 299us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.261990:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00010000:00010000:3.0:1788836762.368618:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836762.560235:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.560281:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.560309:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.560338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.560357:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.560391:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303616 00000100:00100000:3.0:1788836762.560401:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.560402:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303616 00000100:00100000:3.0:1788836762.560433:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.560449:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.560456:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304128 00000100:00100000:0.0:1788836762.560459:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304128 00000100:00100000:0.0:1788836762.560472:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303488 00000100:00100000:0.0:1788836762.560474:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303488 00000100:00100000:3.0:1788836762.560486:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.560488:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304000 00000100:00100000:0.0:1788836762.560490:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304000 00000100:00100000:3.0:1788836762.560507:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836762.560529:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303616:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836762.560530:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:0.0:1788836762.560535:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770304128:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788836762.560598:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770304128:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.560606:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788836762.560618:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303104 00000100:00100000:1.0:1788836762.560622:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303104 00000100:00100000:0.0:1788836762.560623:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788836762.560629:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303488:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788836762.560650:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:2.0:1788836762.560693:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303360 00000100:00100000:2.0:1788836762.560697:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303360 00000100:00100000:2.0:1788836762.560719:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303872 00000100:00100000:2.0:1788836762.560722:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303872 00000100:00100000:1.0:1788836762.560750:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770303104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788836762.560784:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303232 00000100:00100000:2.0:1788836762.560787:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303232 00000100:00100000:2.0:1788836762.560801:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770303744 00000100:00100000:2.0:1788836762.560805:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770303744 00000100:00100000:2.0:1788836762.560817:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788836762.560823:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303360:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836762.560931:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303616:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 403us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.560949:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788836762.560964:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1788836762.560971:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770304000:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836762.561003:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770304000:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.561047:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1788836762.561073:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:3.0:1788836762.561080:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770303872:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836762.561106:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+5:2394:x1875730770303872:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.561113:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:3.0:1788836762.561128:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836762.561134:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:2394:x1875730770303232:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836762.561156:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:2394:x1875730770303232:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.561162:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836762.561172:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788836762.561178:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:2394:x1875730770303744:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788836762.561214:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8312a3a8-0009-48d4-b1d6-f1e7ee1c98d2+12:2394:x1875730770303744:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836762.561220:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00080000:3.0:1788836762.561236:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836762.561241:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836762.565186:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303488:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 4541us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.565202:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788836762.568178:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02a66b92-676f-4a0a-93db-5a4922690379+13:2394:x1875730770303104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 7417us (7940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.568196:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:2.0:1788836762.571667:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade439f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2394:x1875730770303360:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 10833us (11374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.571681:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000040:00080000:2.0:1788836762.814343:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788836762.814358:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836762.814409:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788836762.814419:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788836762.814565:0:17217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17217:1875730782969344:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836762.814663:0:17217:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade43850000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836762.818813:0:17217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf444fad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17217:1875730782969344:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836762.819976:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.820132:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304256 00000100:00100000:0.0:1788836762.820142:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304256 00000100:00100000:0.0:1788836762.820215:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1788836762.820228:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15673:x1875730770304256:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836762.820260:0:17183:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836762.820395:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15673:x1875730770304256:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 163us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.820423:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788836762.827606:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.827722:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304384 00000100:00100000:1.0:1788836762.827733:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304384 00000100:00100000:1.0:1788836762.827796:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788836762.827807:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15673:x1875730770304384:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788836762.827880:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.827899:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.827910:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.827985:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.827994:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828001:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828102:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828112:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828118:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836762.828182:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788836762.828192:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836762.828206:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828216:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828222:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828229:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828235:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea000 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.828239:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828246:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828260:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adf45408300) 00010000:00010000:1.0:1788836762.828263:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.828267:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828275:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea000/0xf7b38383a655583e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828292:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828297:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828313:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828318:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ea800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.828321:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828327:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828335:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.828338:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.828341:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828346:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ea800/0xf7b38383a6555845 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828362:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828369:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828375:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828380:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf80586400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.828383:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828399:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828408:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:1.0:1788836762.828411:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.828414:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.828419:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586400/0xf7b38383a655584c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.828498:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15673:x1875730770304384:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 692us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.828516:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788836762.833708:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.834129:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304640 00000100:00100000:0.0:1788836762.834139:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304640 00000100:00100000:0.0:1788836762.834211:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1788836762.834222:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+28:15673:x1875730770304640:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836762.834245:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836762.834265:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a6555853 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7ec expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834366:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834381:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834392:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836762.834404:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836762.834491:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834500:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834517:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834523:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade43993a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:0.0:1788836762.834527:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834551:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834565:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:0.0:1788836762.834568:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836762.834573:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834578:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655585a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834624:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a6555853 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ec expref: 30 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834635:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adf45408300) 00010000:00010000:0.0:1788836762.834637:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836762.834640:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a6555853 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7ec expref: 30 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.834649:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992200, rc 0) 00000100:00100000:0.0:1788836762.834721:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+29:15673:x1875730770304640:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 501us (1023us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788836762.834730:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1788836762.837233:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.837332:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770304768 00000100:00100000:2.0:1788836762.837343:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770304768 00000100:00100000:2.0:1788836762.837424:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:2.0:1788836762.837434:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+29:15673:x1875730770304768:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836762.837467:0:18652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836762.837603:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade445e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+29:15673:x1875730770304768:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.837641:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1788836762.851304:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.852327:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305024 00000100:00100000:0.0:1788836762.852339:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305024 00000100:00100000:0.0:1788836762.852409:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788836762.852419:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+29:15673:x1875730770305024:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836762.852458:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836762.852482:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a6555868 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7f3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836762.852965:0:17183:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1788836762.852972:0:17183:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788836762.852987:0:17183:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788836762.853175:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655586f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.853190:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655586f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.853201:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655586f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.853255:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a6555868 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7f3 expref: 32 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.853273:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655586f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7f3 expref: 31 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.853282:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade43819100) 00010000:00010000:0.0:1788836762.853284:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836762.853288:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43993a00, rc 0) 00000100:00100000:0.0:1788836762.853356:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+31:15673:x1875730770305024:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 938us (2064us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788836762.853363:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788836762.856934:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.857049:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305280 00000100:00100000:2.0:1788836762.857059:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305280 00000100:00100000:2.0:1788836762.857107:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:2.0:1788836762.857116:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+31:15673:x1875730770305280:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836762.857175:0:18652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836762.857202:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43993a00/0xf7b38383a655586f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7f3 expref: 31 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857221:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade43819100) 00010000:00010000:2.0:1788836762.857231:0:18652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836762.857256:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857270:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857280:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857317:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857324:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857330:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857390:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857397:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857414:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857420:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836762.857424:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857433:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857442:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:2.0:1788836762.857445:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836762.857449:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857454:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031a00/0xf7b38383a655587d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857465:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857471:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857476:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857487:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030a00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836762.857490:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857496:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857513:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf6ea3269 (ffff8adf45408400) 00010000:00010000:2.0:1788836762.857517:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836762.857520:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.857526:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030a00/0xf7b38383a6555884 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6ea3269 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.857614:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+30:15673:x1875730770305280:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 499us (689us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836762.857630:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:3.0:1788836762.860185:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.860277:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305408 00000100:00100000:1.0:1788836762.860288:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305408 00000100:00100000:1.0:1788836762.860364:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:1.0:1788836762.860374:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+30:15673:x1875730770305408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836762.860394:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836762.860426:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a655588b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa7fa expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860463:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587c00/0xf7b38383a6555892 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860494:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587c00/0xf7b38383a6555892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860516:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587c00/0xf7b38383a6555892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860655:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a655588b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7fa expref: 32 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860675:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587c00/0xf7b38383a6555892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7fa expref: 31 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.860683:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.860686:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836762.860689:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf80587c00, rc 0) 00000100:00100000:1.0:1788836762.860755:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+31:15673:x1875730770305408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 381us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.860762:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1788836762.863655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.863734:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305664 00000100:00100000:2.0:1788836762.863744:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305664 00000100:00100000:2.0:1788836762.863805:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:2.0:1788836762.863816:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+31:15673:x1875730770305664:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836762.863895:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.863911:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.863923:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836762.864137:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788836762.864146:0:18652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 546770133477ns, next at 547770131597ns, rc = 0 00000004:00010000:2.0:1788836762.864208:0:18652:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d994314 reply state 00000000f5702f3e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.864222:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.864230:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:2.0:1788836762.864233:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788836762.864237:0:18652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836762.864329:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+33:15673:x1875730770305664:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 514us (682us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788836762.864336:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1788836762.867514:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.872098:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305792 00000100:00100000:1.0:1788836762.872115:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305792 00000100:00100000:1.0:1788836762.872203:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:1.0:1788836762.872214:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+33:15673:x1875730770305792:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836762.872237:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836762.872257:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa801 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.872311:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 34 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.872341:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 34 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.872362:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.872366:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836762.872370:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adf80586600, rc 0) 00000100:00100000:1.0:1788836762.872454:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+34:15673:x1875730770305792:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 242us (4960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.872461:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788836762.883866:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.884370:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770305920 00000100:00100000:0.0:1788836762.884403:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770305920 00000100:00100000:0.0:1788836762.884475:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788836762.884486:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2396:x1875730770305920:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788836762.884767:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2396:x1875730770305920:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 281us (910us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788836762.884774:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788836762.895951:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.896957:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770306176 00000100:00100000:2.0:1788836762.896970:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770306176 00000100:00100000:2.0:1788836762.897061:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1788836762.897072:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+34:15673:x1875730770306176:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836762.897480:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade44553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+35:15673:x1875730770306176:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 408us (1554us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788836762.897488:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1788836762.906183:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.907802:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770306432 00000100:00100000:2.0:1788836762.907820:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770306432 00000100:00100000:2.0:1788836762.907902:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:2.0:1788836762.907913:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+35:15673:x1875730770306432:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836762.908722:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+35:15673:x1875730770306432:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 807us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836762.908746:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1788836762.918188:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.918418:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770306560 00000100:00100000:0.0:1788836762.918429:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770306560 00000100:00100000:0.0:1788836762.918496:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1788836762.918516:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+35:15673:x1875730770306560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836762.918536:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836762.918556:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a65558a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa808 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918627:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918642:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918653:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836762.918700:0:17183:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836762.918720:0:17183:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918747:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992200/0xf7b38383a65558a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa808 expref: 37 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918789:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa808 expref: 36 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.918799:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:0.0:1788836762.918803:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788836762.918807:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992400, rc 0) 00000100:00100000:0.0:1788836762.918878:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade428d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+36:15673:x1875730770306560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 372us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.918886:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788836762.926381:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.926502:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770306688 00000100:00100000:0.0:1788836762.926522:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770306688 00000100:00100000:0.0:1788836762.926589:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1788836762.926599:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+6:2394:x1875730770306688:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836762.926618:0:18692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836762.926649:0:18692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa80f expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836762.926675:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7b9a, blocks: 0x0 00010000:00010000:0.0:1788836762.926695:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=546s v=(0 0) 00010000:00010000:0.0:1788836762.926701:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836762.926710:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 7 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.926730:0:18692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 7 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.926768:0:18692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992200, rc 0) 00000100:00100000:0.0:1788836762.926833:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2394:x1875730770306688:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 234us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.926840:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:3.0:1788836762.931370:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.931548:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770306944 00000100:00100000:1.0:1788836762.931558:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770306944 00000100:00100000:1.0:1788836762.931618:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1788836762.931630:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+36:15673:x1875730770306944:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836762.931748:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+36:15673:x1875730770306944:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.931755:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:3.0:1788836762.938323:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.938645:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307072 00000100:00100000:0.0:1788836762.938655:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307072 00000100:00100000:0.0:1788836762.938719:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1788836762.938730:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+36:15673:x1875730770307072:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788836762.942361:0:17161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788836762.942379:0:17161:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788836762.942445:0:17161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788836762.942622:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942634:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942642:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942648:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:3.0:1788836762.942652:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942675:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942693:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:3.0:1788836762.942696:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788836762.942702:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.942707:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031600/0xf7b38383a6555742 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.944314:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15673:x1875730770307072:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 5578us (5994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.944328:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:2.0:1788836762.944529:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782969472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788836762.944585:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836762.945418:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782969472 00000100:00100000:0.0:1788836762.945428:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782969472 00000100:00100000:0.0:1788836762.945472:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836762.945481:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730782969472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788836762.945611:0:19115:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788836762.945615:0:19115:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788836762.945617:0:19115:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788836762.945619:0:19115:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788836762 -> 1788836762 00002000:00010000:0.0:1788836762.945622:0:19115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788836762.945669:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730782969472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (1083us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788836762.945675:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1788836762.945889:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ade43908e00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788836762.945896:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875730782969472:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788836762.946296:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946309:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946318:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946325:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f80c00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.946336:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946345:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946364:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adf46934600) 00010000:00010000:1.0:1788836762.946367:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.946373:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946379:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80c00/0xf7b38383a65556ee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946488:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946494:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946501:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946513:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.946516:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946521:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946529:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adf46934f00) 00010000:00010000:1.0:1788836762.946531:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.946546:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946551:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81400/0xf7b38383a65556f5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946563:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946568:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946573:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946578:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.946581:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946586:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946594:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8adf45408d00) 00010000:00010000:1.0:1788836762.946597:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.946599:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946604:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030200/0xf7b38383a655579d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946618:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946635:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946641:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946646:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429ebe00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.946648:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946654:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946661:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:1.0:1788836762.946663:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836762.946666:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946672:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429ebe00/0xf7b38383a6555822 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946685:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946692:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946697:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946702:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40030600 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836762.946710:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946716:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946723:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.946725:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788836762.946728:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.946734:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030600/0xf7b38383a6555899 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836762.953854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.953971:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307200 00000100:00100000:0.0:1788836762.953997:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307200 00000100:00100000:0.0:1788836762.954087:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1788836762.954098:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2394:x1875730770307200:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788836762.954519:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7a757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2394:x1875730770307200:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 422us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.954527:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788836762.956855:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.956973:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307456 00000100:00100000:1.0:1788836762.956983:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307456 00000100:00100000:1.0:1788836762.957075:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:1.0:1788836762.957084:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+15:15673:x1875730770307456:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836762.957140:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836762.957179:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade43992400/0xf7b38383a65558ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa808 expref: 15 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.957199:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.957205:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836762.957239:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587400/0xf7b38383a65558bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.957253:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587400/0xf7b38383a65558bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.957262:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587400/0xf7b38383a65558bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836762.958147:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f3c1f18 reply state 00000000ec83ca0d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587400/0xf7b38383a65558bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.958345:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587400/0xf7b38383a65558bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.958355:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836762.958358:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836762.958361:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836762.958903:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+16:15673:x1875730770307456:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1815us (2053us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788836762.958913:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:3.0:1788836762.962914:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.963918:0:19115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307584 00000100:00100000:0.0:1788836762.963933:0:19115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307584 00000100:00100000:0.0:1788836762.964099:0:19115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788836762.964109:0:19115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:15673:x1875730770307584:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836762.964126:0:19115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836762.964141:0:19115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa816 expref: -99 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.964171:0:19115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 8 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.964180:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836762.964184:0:19115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836762.964190:0:19115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 8 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.964224:0:19115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 8 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.964249:0:19115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 8 pid: 18692 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.964260:0:19115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19115:1875730782969600:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788836762.964336:0:19115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf46e22600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836762.969781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.970035:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307712 00000100:00100000:1.0:1788836762.970045:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307712 00010000:00010000:1.0:1788836762.970088:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 9 pid: 18692 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.970121:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788836762.970131:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:2395:x1875730770307712:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836762.970145:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836762.970178:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 9 pid: 18692 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.970194:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 9 pid: 18692 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.970219:0:17167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836762.970223:0:17167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836762.970230:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.970260:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.970296:0:17167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.970309:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43863800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17167:1875730782969728:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788836762.970558:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788836762.970875:0:19115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa0497c/0xf7b38383a65558b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa80f expref: 9 pid: 18692 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836762.970891:0:19115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19115:1875730782969600:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788836762.970915:0:19115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 8 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.970926:0:19115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade43992a00, rc 0) 00000100:00100000:0.0:1788836762.974517:0:19115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf463da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+8:15673:x1875730770307584:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 9508us (10712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.974531:0:19115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788836762.974571:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43863800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17167:1875730782969728:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788836762.974595:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836762.974637:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43909c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2395:x1875730770307712:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4507us (4865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836762.974645:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788836762.978213:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836762.978279:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307840 00000100:00100000:0.0:1788836762.978290:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307840 00000100:00100000:0.0:1788836762.978424:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788836762.978436:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2395:x1875730770307840:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788836762.978592:0:18689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788836762.978595:0:18689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788836762 00002000:00010000:0.0:1788836762.978598:0:18689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788836761 00002000:00010000:0.0:1788836762.978600:0:18689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788836762 -> 1788836762 00002000:00010000:0.0:1788836762.978602:0:18689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788836762.978734:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+8:2395:x1875730770307840:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 299us (530us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788836762.978741:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1788836762.981266:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836762.981328:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770307968 00000100:00100000:3.0:1788836762.981337:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770307968 00000100:00100000:3.0:1788836762.981405:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836762.981415:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+8:2397:x1875730770307968:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788836762.981472:0:18690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.981490:0:18690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 8 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.981500:0:18690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836762.981514:0:18690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836762.981519:0:18690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.981557:0:18690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 8 pid: 19115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836762.981573:0:18690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 8 pid: 19115 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836762.981587:0:18690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18690:1875730782969856:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788836762.981666:0:18690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ade410c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836762.983849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836762.983948:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308096 00000100:00100000:2.0:1788836762.983957:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308096 00010000:00010000:2.0:1788836762.983992:0:17168:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.984063:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788836762.984074:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+9:2394:x1875730770308096:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836762.984088:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836762.984109:0:17168:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.984124:0:17168:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.984147:0:17168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836762.984152:0:17168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836762.984170:0:17168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.984180:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836762.984199:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836762.984216:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010efe21c/0xf7b38383a65558c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa816 expref: 9 pid: 19115 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836762.984240:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dda4d66-c699-4d7b-9c87-3e7b02502788+8:2394:x1875730770308096:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 168us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.984242:0:18690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18690:1875730782969856:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788836762.984247:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00010000:00010000:0.0:1788836762.984262:0:18690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984273:0:18690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984280:0:18690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984301:0:18690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984309:0:18690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984317:0:18690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984323:0:18690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f80000 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836762.984327:0:18690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984335:0:18690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984352:0:18690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.984360:0:18690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000340cebc7/0xf7b38383a65558ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.984414:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2397:x1875730770307968:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 3000us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.984422:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788836762.988103:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.988200:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308352 00000100:00100000:1.0:1788836762.988210:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308352 00000100:00100000:1.0:1788836762.988260:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788836762.988270:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+16:15673:x1875730770308352:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788836762.988354:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.988371:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 16 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.988416:0:17182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.988449:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 16 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.988465:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 16 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.988478:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969984:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836762.988570:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836762.992159:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836762.992181:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782969984:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836762.992206:0:17182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.992340:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308480 00000100:00100000:0.0:1788836762.992357:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308480 00010000:00010000:0.0:1788836762.992396:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 17 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836762.992437:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788836762.992447:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+17:2395:x1875730770308480:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836762.992462:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836762.992469:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 17 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992482:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 17 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992534:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40030000/0xf7b38383a655581b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7d7 expref: 17 pid: 18652 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992574:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:0.0:1788836762.992592:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 16 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992602:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992610:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.992625:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836762.993361:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836762.993425:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+16:2395:x1875730770308480:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 976us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836762.993434:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00010000:00010000:1.0:1788836762.999095:0:17182:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999111:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999324:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999342:0:17182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999361:0:17182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999405:0:17182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836762.999421:0:17182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 16 pid: 17182 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836762.999436:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782970112:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788836762.999534:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836763.005909:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788836763.006280:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308608 00000100:00100000:0.0:1788836763.006291:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308608 00010000:00010000:0.0:1788836763.006360:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 17 pid: 17182 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836763.006403:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1788836763.006413:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+17:2395:x1875730770308608:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836763.006426:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836763.006433:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 17 pid: 17182 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.006467:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 17 pid: 17182 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.006488:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:0.0:1788836763.006494:0:17166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.006514:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.006522:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.006541:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836763.006594:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+17:2395:x1875730770308608:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 182us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836763.006602:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00080000:3.0:1788836763.006792:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836763.017066:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80586600/0xf7b38383a65558a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0x93c51954239fa801 expref: 16 pid: 17182 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836763.017096:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782970112:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788836763.017123:0:17182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.017132:0:17182:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.017137:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836763.017264:0:17182:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788836763.017372:0:17182:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788836763.017405:0:17182:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788836763.017481:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17182:1875730782970240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836763.017573:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836763.017607:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836763.017931:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782970240 00000100:00100000:2.0:1788836763.017940:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782970240 00000100:00100000:2.0:1788836763.018046:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836763.018057:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17182:x1875730782970240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836763.018151:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17182:x1875730782970240:12345-0@lo:1000:mdt00_001.0 Request processed in 96us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836763.018169:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788836763.018198:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836763.019193:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17182:1875730782970240:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788836763.019386:0:17182:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788836763.019454:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17182:1875730782970368:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836763.019497:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836763.019538:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf77337780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836763.019591:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782970368 00000100:00100000:3.0:1788836763.019610:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782970368 00000100:00100000:3.0:1788836763.019660:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836763.019670:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17182:x1875730782970368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788836763.019791:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17182:x1875730782970368:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (292us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788836763.019799:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788836763.019860:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17182:1875730782970368:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788836763.019896:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019905:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019912:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019918:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf80587200 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836763.019923:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019930:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019946:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:1.0:1788836763.019949:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836763.019954:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019960:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587200/0xf7b38383a65558d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.019992:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020005:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020044:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020049:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf429eb800 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:1.0:1788836763.020052:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020059:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020068:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:1.0:1788836763.020070:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836763.020078:0:17182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020090:0:17182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020099:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.020150:0:17182:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f80e00/0xf7b38383a6555837 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa7e5 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836763.020275:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782970496:192.168.201.38@tcp:105: 00000100:00100000:2.0:1788836763.020396:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adf65e2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836763.025045:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43860380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17182:1875730782970496:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788836763.025077:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025087:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf429eb800/0xf7b38383a6555830 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025124:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025139:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025166:0:17182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025176:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025183:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025189:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025195:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836763.025198:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025205:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025216:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836763.025219:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836763.025222:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025228:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025238:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025243:0:17182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025258:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025263:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf80587e00 already unused, calling callback (ffffffffc1ae54f0) 00010000:00010000:2.0:1788836763.025266:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025272:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025281:0:17182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:2.0:1788836763.025283:0:17182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836763.025286:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.025291:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf80587e00/0xf7b38383a65558d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836763.025468:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15673:x1875730770308352:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 37198us (37373us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788836763.025479:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000020:00080000:2.0:1788836763.025485:0:17182:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788836763.025517:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788836763.025522:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836763.025536:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788836763.025541:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788836763.030207:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836763.030294:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308736 00000100:00100000:2.0:1788836763.030304:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308736 00000100:00100000:2.0:1788836763.030363:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1788836763.030374:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade42b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15672:x1875730770308736:12345-192.168.201.38@tcp:49:dd.0 00000100:00100000:2.0:1788836763.030518:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade42b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15672:x1875730770308736:12345-192.168.201.38@tcp:49:dd.0 Request processed in 145us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836763.030544:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788836763.032745:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788836763.032821:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770308992 00000100:00100000:2.0:1788836763.032831:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770308992 00000100:00100000:2.0:1788836763.032884:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788836763.032894:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+19:15673:x1875730770308992:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836763.033226:0:17184:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836763.033259:0:17184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788836763.033292:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033309:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033320:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033329:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033335:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033342:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836763.033362:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836763.033757:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836763.033766:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.033773:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf40031400 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836763.033777:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.033785:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.033798:0:17169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ade438f2100) 00010000:00010000:3.0:1788836763.033801:0:17169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836763.033806:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.033813:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adf40031400/0xf7b38383a65558e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.033825:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836763.033826:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836763.033828:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836763.034765:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15673:x1875730770308992:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1865us (2021us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788836763.034777:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000020:00080000:2.0:1788836763.034797:0:17184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788836763.039952:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836763.040130:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770309120 00000100:00100000:3.0:1788836763.040155:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770309120 00000100:00100000:3.0:1788836763.040220:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788836763.040233:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+21:15672:x1875730770309120:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788836763.040258:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836763.040278:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81800/0xf7b38383a65558ed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93c51954239fa81d expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040312:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a65558f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040326:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a65558f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040337:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a65558f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040477:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81800/0xf7b38383a65558ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa81d expref: 23 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040496:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ade41f81e00/0xf7b38383a65558f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0x93c51954239fa81d expref: 22 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.040515:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adf45408700) 00010000:00010000:3.0:1788836763.040518:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836763.040522:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ade41f81e00, rc 0) 00000100:00100000:3.0:1788836763.040632:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+22:15672:x1875730770309120:12345-192.168.201.38@tcp:101:dd.0 Request processed in 402us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836763.040640:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1788836763.230144:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788836763.230273:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770309248 00000100:00100000:1.0:1788836763.230281:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770309248 00000100:00100000:1.0:1788836763.230351:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788836763.230361:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2395:x1875730770309248:12345-192.168.201.38@tcp:4:dd.0 00002000:00010000:1.0:1788836763.230422:0:18695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f7b9a, atime: 0x6a9f7b99, ctime: 0x6a9f7b9a, blocks: 0x0 00010000:00010000:1.0:1788836763.230430:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.230443:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788836763.230447:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836763.230451:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836763.230463:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836763.232914:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788836763.235605:0:18697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836763.235625:0:18697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788836763.236400:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730770309376 00000100:00100000:2.0:1788836763.236413:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730770309376 00000100:00100000:3.0:1788836763.237007:0:20323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788836763.237061:0:20323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+8:2395:x1875730770309376:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:3.0:1788836763.237096:0:20323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.237114:0:20323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836763.237118:0:20323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836763.237125:0:20323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.237140:0:20323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836763.336896:0:18686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788836763.336914:0:18686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788836763.347538:0:18695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788836763.347547:0:18695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788836762 -> 1788836763 00002000:00010000:0.0:1788836763.347550:0:18695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788836762 -> 1788836763 00002000:00010000:0.0:1788836763.347552:0:18695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1788836763.347570:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347581:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347589:0:18695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347684:0:18695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adf80587200 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:0.0:1788836763.347690:0:18695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347700:0:18695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347718:0:18695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836763.347726:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000743dba6/0xf7b38383a65558fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836763.347882:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5dda4d66-c699-4d7b-9c87-3e7b02502788+7:2395:x1875730770309248:12345-192.168.201.38@tcp:4:dd.0 Request processed in 117517us (117741us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788836763.347896:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000001:00080000:2.0:1788836763.356964:0:18686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:3.0:1788836763.357147:0:20323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357174:0:20323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357182:0:20323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357189:0:20323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ade41f81800 already unused, calling callback (ffffffffc0edb420) 00010000:00010000:3.0:1788836763.357194:0:20323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357202:0:20323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357230:0:20323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836763.357237:0:20323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1c80a5/0xf7b38383a6555902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836763.357717:0:20323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5dda4d66-c699-4d7b-9c87-3e7b02502788+5:2395:x1875730770309376:12345-192.168.201.38@tcp:4:dd.0 Request processed in 120654us (124807us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788836763.357729:0:20323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00010000:00010000:3.0:1788836763.390156:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836763.390226:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836763.390249:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782970624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836763.390322:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836763.391557:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782970624 00000100:00100000:0.0:1788836763.391569:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782970624 00000100:00100000:0.0:1788836763.391650:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836763.391660:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782970624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836763.391683:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:0.0:1788836763.391749:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf77369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782970624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836763.391755:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836763.391943:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782970624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836763.392143:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836763.902769:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836763.902795:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782970752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836763.902873:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836763.902990:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782970752 00000100:00100000:3.0:1788836763.902999:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782970752 00000100:00100000:3.0:1788836763.903092:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836763.903102:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782970752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836763.903137:0:18651:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788836763.903209:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf444fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875730782970752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836763.903217:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836763.903680:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875730782970752:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788836764.415184:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836764.415307:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782970880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836764.415387:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836764.415704:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782970880 00000100:00100000:3.0:1788836764.415713:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782970880 00000100:00100000:3.0:1788836764.415766:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836764.415793:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782970880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836764.415828:0:17187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836764.415888:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782970880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836764.415896:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836764.416058:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782970880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836764.416541:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836764.416554:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836764.416592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836764.417001:0:20321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971008 00000100:00100000:3.0:1788836764.417008:0:20321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971008 00000100:00100000:3.0:1788836764.417072:0:20321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788836764.417080:0:20321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836764.417096:0:20321:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1788836764.417143:0:20321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade43863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836764.417150:0:20321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836764.417217:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788836764.417234:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ade43908e00, transno 8589934596 00000004:00080000:1.0:1788836764.417252:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788836764.417273:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971008:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788836764.982566:0:20360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1788836765.060690:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788836765.060702:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836765.060721:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788836765.060726:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788836765.439958:0:17170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836766.462484:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836766.462506:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782971136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836766.462571:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836766.462612:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836766.462624:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971136 00000100:00100000:3.0:1788836766.462632:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971136 00000100:00100000:3.0:1788836766.462693:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788836766.462702:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782971136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788836766.462734:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788836766.462779:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875730782971136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836766.462786:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788836766.462807:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836766.462850:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875730782971136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836766.463611:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971392:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463687:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782971904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782972416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463748:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463768:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836766.463775:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971520:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463797:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463815:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782972032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463833:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463848:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782972544:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.463866:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.463905:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971392 00000100:00100000:0.0:1788836766.463910:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971392 00000100:00100000:0.0:1788836766.463940:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971904 00000100:00100000:0.0:1788836766.463943:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971904 00000100:00100000:0.0:1788836766.463957:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836766.463964:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464044:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971392:12345-0@lo:400:kworker.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464052:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836766.464069:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836766.464086:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782971904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464118:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782971904:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464124:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836766.464146:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972416 00000100:00100000:0.0:1788836766.464149:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972416 00000100:00100000:0.0:1788836766.464181:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972544 00000100:00100000:0.0:1788836766.464184:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972544 00000100:00100000:0.0:1788836766.464204:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836766.464210:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782972416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464239:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875730782972416:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464246:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836766.464258:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836766.464264:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782972544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464289:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875730782972544:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464295:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836766.464312:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971520 00000100:00100000:0.0:1788836766.464315:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971520 00000100:00100000:0.0:1788836766.464336:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972032 00000100:00100000:0.0:1788836766.464338:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972032 00000100:00100000:0.0:1788836766.464355:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836766.464361:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464390:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875730782971520:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464396:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836766.464416:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836766.464422:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782972032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464464:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875730782972032:12345-0@lo:400:kworker.0 Request processed in 42us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464469:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836766.464512:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782971648:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464537:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464555:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782972160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464576:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464592:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782972672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464610:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464627:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788836766.464633:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782971264:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464660:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464685:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782971776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464721:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464736:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782972288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464753:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836766.464776:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971264 00000100:00100000:0.0:1788836766.464781:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971264 00000100:00100000:0.0:1788836766.464805:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836766.464811:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464841:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adf7aa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2+24:3614:x1875730782971264:12345-0@lo:400:kworker.0 Request processed in 30us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464847:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788836766.464878:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972160 00000100:00100000:0.0:1788836766.464882:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972160 00000100:00100000:0.0:1788836766.464898:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972672 00000100:00100000:0.0:1788836766.464900:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972672 00000100:00100000:0.0:1788836766.464910:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971776 00000100:00100000:0.0:1788836766.464913:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971776 00000100:00100000:0.0:1788836766.464922:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972288 00000100:00100000:0.0:1788836766.464924:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972288 00000100:00100000:0.0:1788836766.464937:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836766.464943:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782972160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.464974:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875730782972160:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.464980:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836766.464992:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836766.464998:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782972672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465045:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875730782972672:12345-0@lo:400:kworker.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.465051:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836766.465065:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836766.465071:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782971776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465098:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875730782971776:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.465103:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836766.465114:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788836766.465119:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782972288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465143:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875730782972288:12345-0@lo:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.465158:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788836766.465182:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836766.465186:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836766.465188:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836766.465203:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782971648 00000100:00100000:0.0:1788836766.465206:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782971648 00000100:00100000:0.0:1788836766.465231:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836766.465237:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782971648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465267:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782971648:12345-0@lo:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836766.465273:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788836766.465288:0:17177:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836766.465311:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec97e3d3-1f2f-4e4f-9a6b-f450ee50bdb2:3614:1875730782971264:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465323:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875730782971776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465332:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875730782972288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465340:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782971648:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465349:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adf463dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875730782972160:0@lo:400:kworker.0 00010000:00080000:0.0:1788836766.465360:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c4700 x1875730782972672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836766.465370:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875730782972672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465407:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971520:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465418:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade4390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782972032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465427:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875730782972544:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465458:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875730782971392:0@lo:400:kworker.0 00000100:00100000:0.0:1788836766.465470:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade43909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875730782971904:0@lo:400:kworker.0 00010000:00080000:0.0:1788836766.465481:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ade436c4000 x1875730782972416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836766.465489:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875730782972416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836766.467184:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836766.467207:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ade436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782972800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836766.467269:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836766.467310:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730782972800 00000100:00100000:3.0:1788836766.467316:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730782972800 00000100:00100000:3.0:1788836766.467354:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836766.467362:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782972800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836766.467382:0:18693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788836766.467426:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ade436fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875730782972800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836766.467433:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836766.467485:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ade436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875730782972800:0@lo:13:osp-pre-1-0.0 Debug log: 43419 lines, 43419 kept, 0 dropped, 0 bad.